-- Logs begin at Mon 2021-11-15 11:57:14 UTC, end at Mon 2021-11-15 12:59:48 UTC. -- Nov 15 12:31:16.375202 dv-cinder-803823-7-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 15 12:31:19.102727 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.common.config [-] Logging enabled! Nov 15 12:31:19.103341 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 15 12:31:19.103499 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108179) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 15 12:31:19.106766 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.common.config [-] Logging enabled! Nov 15 12:31:19.107014 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev179 Nov 15 12:31:19.107317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108179) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 15 12:31:19.108273 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:31:19.108500 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:31:19.108858 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:31:19.109098 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:31:19.109319 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:31:19.109632 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.110043 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 15 12:31:19.110345 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.110631 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.110917 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.111208 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.111487 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.111763 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.112045 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.112360 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.112646 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.112919 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.113195 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.113477 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.113749 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] config_source = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.114027 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.114616 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.114616 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] debug = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.114868 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.115268 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.115682 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.115954 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.116256 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.116530 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.116805 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.117058 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.117331 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.117649 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] host = dv-cinder-803823-7-iscsi {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.117919 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.118204 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.118477 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.118752 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.119017 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.119284 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.119557 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.119821 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_dir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.120087 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.120378 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.120657 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.120935 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.121219 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.121436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.121652 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.121933 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.122209 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.122482 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.122749 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.123015 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.123280 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.123546 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.123812 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.124090 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.124453 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.124731 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.125000 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.125266 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.125530 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.125795 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.126068 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.126333 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.126600 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.126866 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.127144 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.127404 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.127670 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.127964 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.128263 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.128541 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.128816 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.129082 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.129356 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.129620 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.129909 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_journal = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.130173 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_json = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.130436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.130699 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.130970 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.131233 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.131493 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.131756 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.132018 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.132314 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:19.132608 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.132895 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.133187 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.133456 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.133749 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.134020 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.134298 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.134566 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.134843 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.135119 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.135395 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.135661 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.135939 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.136242 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.136528 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.136821 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.137108 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.137387 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.137651 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.137917 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.138180 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.138449 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.138726 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.138994 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.139271 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.139548 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.139818 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.140094 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.140399 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.140679 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.140943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.141210 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.141488 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.141756 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.142017 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.142283 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.142564 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.142831 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.143092 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.143365 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.143635 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.143902 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.144191 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.144462 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.144742 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.145009 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.145269 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.146055 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.146361 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.146624 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.146901 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.147170 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.147434 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.147696 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.147965 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.148249 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.148514 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.148781 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.149043 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.149311 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.149574 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.149834 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.150098 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.150360 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.150621 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.150882 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.151145 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.151412 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.151673 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.151935 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.152226 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.152492 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.152756 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.153038 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.153581 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.153851 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.154120 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.154390 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.154661 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.154929 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.155196 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.155465 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.155733 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.155998 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.156302 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.156580 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.156860 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.157136 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.157405 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.157718 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.157989 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.158264 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.158533 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.158803 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.159077 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.159353 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.159635 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.160019 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.160336 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.160620 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.160905 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.161723 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.162028 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.162302 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:19.162515 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:31:19.162750 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=108179) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 15 12:31:19.588493 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:31:19.588767 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:31:19.589063 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:31:19.589391 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 15 12:31:19.916765 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.916976 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.917242 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.918438 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.918712 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.919087 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.952534 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.952804 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.953063 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.970258 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.970532 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.970796 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.999272 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.999550 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:19.999811 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.035865 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.036706 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.036982 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.273143 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.273705 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.273705 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.273919 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.274615 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.399817 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.400156 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.400434 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.400703 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.400966 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.401270 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.401524 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.401775 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.402025 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.402301 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.402559 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.402820 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.403071 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.403564 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.403817 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.404076 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.404411 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.404672 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.404935 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.405189 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.405453 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.405700 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.405975 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.406348 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.406597 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.406841 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.407233 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.407467 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.407698 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.407927 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.408178 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.408409 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:20.408770 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 15 12:31:20.412002 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 15 12:31:20.415948 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 15 12:31:20.419877 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])]) Nov 15 12:31:20.421515 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 15 12:31:20.421970 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 15 12:31:20.422299 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 15 12:31:20.422684 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 15 12:31:20.425613 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 15 12:31:20.425852 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 15 12:31:20.426198 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 15 12:31:20.431798 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 15 12:31:20.454688 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 15 12:31:20.455091 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.455380 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=108179) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:89}} Nov 15 12:31:20.455739 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.457135 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=108179) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 15 12:31:20.457413 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 15 12:31:20.457655 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 15 12:31:20.461425 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.461702 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:20.525139 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 15 12:31:20.525371 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 15 12:31:20.525606 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 15 12:31:20.525967 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 15 12:31:20.546682 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_db.sqlalchemy.engines [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:31:21.073116 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing driver for type 'gre' Nov 15 12:31:21.073638 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] gre ID ranges: [(1, 1000)] Nov 15 12:31:21.128599 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing driver for type 'local' Nov 15 12:31:21.128930 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing driver for type 'vlan' Nov 15 12:31:21.140979 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] VlanTypeDriver initialization complete Nov 15 12:31:21.141372 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing driver for type 'vxlan' Nov 15 12:31:21.141878 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] vxlan ID ranges: [(1, 1000)] Nov 15 12:31:21.192956 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing extension driver 'port_security' Nov 15 12:31:21.193326 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.extensions.port_security [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] PortSecurityExtensionDriver initialization complete Nov 15 12:31:21.193671 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing mechanism driver 'openvswitch' Nov 15 12:31:21.193992 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing mechanism driver 'hyperv' Nov 15 12:31:21.200557 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.plugin [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=108179) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:21.201413 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.201782 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.202129 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.202661 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.203085 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.203432 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.203771 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.204422 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.204571 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.204913 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.205250 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.205632 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.206032 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.206375 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.206709 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.207095 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.207494 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.207835 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.208236 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.208633 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.209034 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > address_group after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.209375 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > address_group after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.209705 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > address_group after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.210086 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=108179) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 15 12:31:21.210458 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] ML2 OVO RPC backend initialized. {{(pid=108179) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 15 12:31:21.211164 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.211517 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.211934 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.212296 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > networks before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.212645 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.212979 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > ports before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.213313 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.213644 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnets before_response 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.213981 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.214313 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.214639 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.214965 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.215291 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.215615 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.215939 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.216294 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.216619 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > subnet after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.217182 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.plugin [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Modular L2 Plugin initialization complete Nov 15 12:31:21.217502 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading services supported by the core plugin {{(pid=108179) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 15 12:31:21.217823 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.plugins.ml2.managers [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Got port-security extension from driver 'port_security' Nov 15 12:31:21.218283 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.extensions.vlantransparent [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Disabled vlantransparent extension. Nov 15 12:31:21.218759 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=108179) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 15 12:31:21.219065 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: router Nov 15 12:31:21.256896 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.257281 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_create 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.257644 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router before_create 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.258007 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.258376 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.258731 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_delete 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.259081 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > floatingip after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.259546 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > floatingip after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.259903 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_create 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.260274 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.260622 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.260965 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.261317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.261724 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.262090 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.262427 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.262760 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: subnet after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.263092 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.263439 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > port precommit_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.263782 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_create 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.264147 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.264482 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.264840 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router after_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.265176 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_delete 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.265520 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_create 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.265874 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router_interface after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.266213 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_update 55549900 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.266571 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > agent after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.266914 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > agent after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.267250 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > network after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.268102 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Tracking information for resource: router configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:21.268455 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Tracking information for resource: floatingip configured {{(pid=108179) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 15 12:31:21.273846 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.db.l3_agentschedulers_db [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 15 12:31:21.274424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.274782 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.275130 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.275477 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: port after_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.276295 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router before_create 55550100 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.276657 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_delete 55550100 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.277013 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_create 55550100 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.277365 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > router precommit_update 55550100 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.282455 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.provider_configuration [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service providers = [] {{(pid=108179) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 15 12:31:21.282813 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.db.servicetype_db [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=108179) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 15 12:31:21.285767 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.service_base [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=108179) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 12:31:21.286108 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.service_base [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=108179) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 12:31:21.286442 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.service_base [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=108179) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 12:31:21.287862 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.services.service_base [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=108179) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 15 12:31:21.288260 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.services.service_base [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 15 12:31:21.288626 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.288935 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 15 12:31:21.299592 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.299920 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: auto_allocate Nov 15 12:31:21.305650 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: network precommit_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.306009 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: network precommit_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.306519 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.306832 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: tag Nov 15 12:31:21.313538 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.313860 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: timestamp Nov 15 12:31:21.317651 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.317979 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: network_ip_availability Nov 15 12:31:21.323508 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.323824 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.324202 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.324901 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.325216 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: flavors Nov 15 12:31:21.330136 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.330464 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading Plugin: revisions Nov 15 12:31:21.335273 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=108179) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 15 12:31:21.335652 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.746s {{(pid=108179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:31:21.336419 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=108179) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 15 12:31:21.336751 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Initializing extension manager. Nov 15 12:31:21.337259 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: __init__.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.337594 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: __pycache__ {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.337924 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.338256 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: address_group.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.338997 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.339554 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: address-group Nov 15 12:31:21.339871 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: address_scope.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.340604 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.341103 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: address-scope Nov 15 12:31:21.341421 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: admin_state_down_before_update.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.342339 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.342837 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: router-admin-state-down-before-update Nov 15 12:31:21.343153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: agent.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.343843 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.344371 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: agent Nov 15 12:31:21.344685 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: agent_resources_synced.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.345584 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.346076 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: agent-resources-synced Nov 15 12:31:21.346389 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: allowedaddresspairs.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.348176 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.348694 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: allowed-address-pairs Nov 15 12:31:21.349018 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: auto_allocated_topology.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.350734 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.351239 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: auto-allocated-topology Nov 15 12:31:21.351557 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: availability_zone.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.352279 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.352803 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: availability_zone Nov 15 12:31:21.353119 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: availability_zone_filter.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.354021 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.354518 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: availability_zone_filter Nov 15 12:31:21.354834 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: data_plane_status.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.355733 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.356258 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension data-plane-status not supported by any of loaded plugins Nov 15 12:31:21.356580 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: default_subnetpools.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.357486 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.357987 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: default-subnetpools Nov 15 12:31:21.358311 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: dhcpagentscheduler.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.359104 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.359606 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: dhcp_agent_scheduler Nov 15 12:31:21.359926 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: dns.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.360860 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.361353 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension dns-integration not supported by any of loaded plugins Nov 15 12:31:21.361671 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: dns_domain_ports.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.362578 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.363074 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 15 12:31:21.363393 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.364335 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.364826 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 15 12:31:21.365141 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: dvr.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.365830 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.366324 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: dvr Nov 15 12:31:21.366640 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: ecmp_routes.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.367548 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.368040 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 15 12:31:21.368389 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: empty_string_filtering.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.369294 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.369790 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: empty-string-filtering Nov 15 12:31:21.370105 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.371013 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.371503 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 15 12:31:21.371816 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.372797 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.373290 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 15 12:31:21.373605 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: external_net.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.374511 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.375003 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: external-net Nov 15 12:31:21.375316 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: extra_dhcp_opt.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.376255 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.376750 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: extra_dhcp_opt Nov 15 12:31:21.377065 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: extraroute.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.377993 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.378496 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: extraroute Nov 15 12:31:21.378811 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: extraroute_atomic.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.379867 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.380559 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: extraroute-atomic Nov 15 12:31:21.380903 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: filter_validation.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.381557 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.382047 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: filter-validation Nov 15 12:31:21.382360 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: fip_pf_description.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.383267 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.383755 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 15 12:31:21.384068 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: fip_port_details.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.384993 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.385489 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: fip-port-details Nov 15 12:31:21.385802 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: flavors.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.387014 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.387517 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: flavors Nov 15 12:31:21.387837 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.389518 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.390028 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 15 12:31:21.390347 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: floatingip_pools.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.391035 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.391534 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: floatingip-pools Nov 15 12:31:21.391851 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: ip_allocation.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.392795 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.393289 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension ip_allocation not supported by any of loaded plugins Nov 15 12:31:21.393607 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.394519 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.395018 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: ip-substring-filtering Nov 15 12:31:21.395337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l2_adjacency.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.396373 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.397383 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 15 12:31:21.397701 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.398653 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.399161 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: router Nov 15 12:31:21.399478 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3_conntrack_helper.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.401740 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.402264 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 15 12:31:21.402592 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.403768 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.404295 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: ext-gw-mode Nov 15 12:31:21.404620 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.405547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.406046 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: l3-ha Nov 15 12:31:21.406363 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3_flavors.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.407262 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.407757 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: l3-flavors Nov 15 12:31:21.408075 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.409002 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.409498 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 15 12:31:21.409815 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: l3agentscheduler.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.410839 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.411340 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: l3_agent_scheduler Nov 15 12:31:21.411660 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: logging.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.413735 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.414251 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension logging not supported by any of loaded plugins Nov 15 12:31:21.414576 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: metering.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.415310 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.415879 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: metering Nov 15 12:31:21.416231 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.417436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.417944 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: metering_source_and_destination_fields Nov 15 12:31:21.418267 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: multiprovidernet.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.419191 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.419691 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: multi-provider Nov 15 12:31:21.420011 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: netmtu.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.420947 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.421442 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: net-mtu Nov 15 12:31:21.421758 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: netmtu_writable.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.422661 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.423156 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: net-mtu-writable Nov 15 12:31:21.423476 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: network_availability_zone.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.424410 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.424656 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: network_availability_zone Nov 15 12:31:21.424970 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: network_ip_availability.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.426064 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.426566 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: network-ip-availability Nov 15 12:31:21.426886 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: network_segment_range.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.427644 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.428190 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension network-segment-range not supported by any of loaded plugins Nov 15 12:31:21.428512 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: pagination.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.429490 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.429813 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: pagination Nov 15 12:31:21.430134 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: port_device_profile.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.431040 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.431544 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: port-device-profile Nov 15 12:31:21.431860 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.432799 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.433293 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: port-mac-address-regenerate Nov 15 12:31:21.433607 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.434507 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.435004 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: port-numa-affinity-policy Nov 15 12:31:21.435317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: port_resource_request.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.436259 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.436749 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension port-resource-request not supported by any of loaded plugins Nov 15 12:31:21.437063 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: port_resource_request_groups.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.438023 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.438515 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 15 12:31:21.438836 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: portbindings.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.439758 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.440288 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: binding Nov 15 12:31:21.440606 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: portbindings_extended.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.441876 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.442380 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: binding-extended Nov 15 12:31:21.442704 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: portsecurity.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.443637 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.444166 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: port-security Nov 15 12:31:21.444488 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: project_id.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.445459 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.445780 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: project-id Nov 15 12:31:21.446095 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: providernet.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.447020 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.447518 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: provider Nov 15 12:31:21.447835 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.451405 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.451911 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos not supported by any of loaded plugins Nov 15 12:31:21.452263 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.453496 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.454000 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 15 12:31:21.454325 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.455236 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.455739 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 15 12:31:21.456062 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_default.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.456993 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.457495 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-default not supported by any of loaded plugins Nov 15 12:31:21.457818 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_fip.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.458463 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.459467 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-fip not supported by any of loaded plugins Nov 15 12:31:21.459802 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_gateway_ip.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.460744 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.461246 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 15 12:31:21.461564 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_port_network_policy.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.462467 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.462967 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 15 12:31:21.463287 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.464331 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.464836 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 15 12:31:21.465154 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_pps_rule.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.466315 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.466984 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-pps not supported by any of loaded plugins Nov 15 12:31:21.467305 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_rule_type_details.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.468245 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.468742 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 15 12:31:21.469063 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: qos_rules_alias.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.470118 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.470612 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 15 12:31:21.470929 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: quota_check_limit.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.471835 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.472363 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: quota-check-limit Nov 15 12:31:21.472680 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: quotasv2.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.473589 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.473910 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: quotas Nov 15 12:31:21.474224 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: quotasv2_detail.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.477861 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.478193 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: quota_details Nov 15 12:31:21.478515 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: rbac.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.479570 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.480084 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: rbac-policies Nov 15 12:31:21.480437 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: rbac_address_group.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.481364 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.481866 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: rbac-address-group Nov 15 12:31:21.482188 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: rbac_address_scope.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.483098 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.483601 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: rbac-address-scope Nov 15 12:31:21.483920 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: rbac_security_groups.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.484854 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.485352 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: rbac-security-groups Nov 15 12:31:21.485669 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: rbac_subnetpool.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.486581 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.487083 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: rbac-subnetpool Nov 15 12:31:21.487403 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: revisionifmatch.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.488338 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.488846 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: revision-if-match Nov 15 12:31:21.489164 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: revisions.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.490288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.490787 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: standard-attr-revisions Nov 15 12:31:21.491108 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: router_availability_zone.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.491770 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.492355 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: router_availability_zone Nov 15 12:31:21.492677 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: routerservicetype.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.493602 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.494094 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension router-service-type not supported by any of loaded plugins Nov 15 12:31:21.494413 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.495325 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.495829 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: security-groups-normalized-cidr Nov 15 12:31:21.496174 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: security_groups_port_filtering.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.497158 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.497661 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: port-security-groups-filtering Nov 15 12:31:21.497978 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.498902 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.499406 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: security-groups-remote-address-group Nov 15 12:31:21.499724 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.500672 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.501170 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: security-groups-shared-filtering Nov 15 12:31:21.501486 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.502071 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 15 12:31:21.502385 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: securitygroup.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.512189 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.512711 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: security-group Nov 15 12:31:21.513042 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: segment.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.513818 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.514318 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension segment not supported by any of loaded plugins Nov 15 12:31:21.514641 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.515565 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.516067 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 15 12:31:21.516413 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: servicetype.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.517518 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.518028 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: service-type Nov 15 12:31:21.518353 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: sorting.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.519346 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.519672 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: sorting Nov 15 12:31:21.519990 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: standard_attr_segment.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.520933 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.521435 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 15 12:31:21.522263 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: standardattrdescription.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.522926 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.523425 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: standard-attr-description Nov 15 12:31:21.523744 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: stateful_security_group.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.524680 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.525187 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: stateful-security-group Nov 15 12:31:21.525507 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: stdattrs_common.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.526072 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 15 12:31:21.526389 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.527306 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.527810 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 15 12:31:21.528152 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnet_onboard.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.529468 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.529980 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: subnet_onboard Nov 15 12:31:21.530297 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.531222 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.531723 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 15 12:31:21.532041 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnet_service_types.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.532981 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.533487 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: subnet-service-types Nov 15 12:31:21.533804 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnetallocation.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.534877 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.535388 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: subnet_allocation Nov 15 12:31:21.535707 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.536393 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.536903 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: subnetpool-prefix-ops Nov 15 12:31:21.537826 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.538746 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.539248 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 15 12:31:21.539568 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: tagging.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.540644 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.541149 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: standard-attr-tag Nov 15 12:31:21.541473 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: timestamp.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.542680 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.543187 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loaded extension: standard-attr-timestamp Nov 15 12:31:21.543505 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: trunk.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.544567 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.545070 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension trunk not supported by any of loaded plugins Nov 15 12:31:21.545390 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: trunk_details.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.546308 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.546811 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension trunk-details not supported by any of loaded plugins Nov 15 12:31:21.547129 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: uplink_status_propagation.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.548056 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.548579 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 15 12:31:21.548896 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Loading extension file: vlantransparent.py {{(pid=108179) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 15 12:31:21.549561 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=108179) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 15 12:31:21.550055 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 15 12:31:21.552537 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:network Nov 15 12:31:21.553103 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnet Nov 15 12:31:21.553497 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 12:31:21.553883 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:port Nov 15 12:31:21.556273 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.556719 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service FLAVORS assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.557364 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.557799 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.558126 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:router Nov 15 12:31:21.558557 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:floatingip Nov 15 12:31:21.559048 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service METERING assigned prefix: /metering {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.560507 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.560873 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.561215 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108179) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:31:21.562194 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of CountableResource for resource:rbac_policy Nov 15 12:31:21.562641 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:security_group Nov 15 12:31:21.563077 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 15 12:31:21.563664 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service CORE assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.563987 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 12:31:21.564357 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] subnetpool is already registered Nov 15 12:31:21.564776 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service CORE assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.565096 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 12:31:21.565420 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] subnetpool is already registered Nov 15 12:31:21.567687 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.568132 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service FLAVORS assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.568826 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.569244 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.569577 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:router Nov 15 12:31:21.569912 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] router is already registered Nov 15 12:31:21.570321 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:floatingip Nov 15 12:31:21.570651 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] floatingip is already registered Nov 15 12:31:21.571105 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service METERING assigned prefix: /metering {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.571767 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of CountableResource for resource:rbac_policy Nov 15 12:31:21.572087 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] rbac_policy is already registered Nov 15 12:31:21.572517 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:security_group Nov 15 12:31:21.572849 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] security_group is already registered Nov 15 12:31:21.573245 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 15 12:31:21.573620 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] security_group_rule is already registered Nov 15 12:31:21.574187 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service CORE assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.574511 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 12:31:21.574841 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] subnetpool is already registered Nov 15 12:31:21.575259 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.v2.resource_helper [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Service CORE assigned prefix: {{(pid=108179) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 15 12:31:21.575578 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Creating instance of TrackedResource for resource:subnetpool Nov 15 12:31:21.575903 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING neutron.quota.resource_registry [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] subnetpool is already registered Nov 15 12:31:21.576395 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: extensions {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.577851 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: address-groups {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.579333 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: address-scopes {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.580684 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: agents {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.581838 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: auto-allocated-topology {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.583084 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: availability_zones {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.584857 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: dhcp-networks {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.586358 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: dhcp-agents {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.587755 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: routers {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.589974 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: flavors {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.591152 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: service_profiles {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.592374 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: next_providers {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.593823 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: service_profiles {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.595337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: floatingip-pools {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.596585 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: routers {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.598714 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: floatingips {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.600573 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: l3-routers {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.601961 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: l3-agents {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.603349 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: metering-labels {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.604723 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: metering-label-rules {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.606002 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: network-ip-availabilities {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.607256 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: bindings {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.608927 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: quotas {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.610474 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: quotas {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.611984 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: rbac-policies {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.613352 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: security-groups {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.614575 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: security-group-rules {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.615818 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: service-providers {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.617056 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: subnetpools {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.618457 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: subnetpools {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.619910 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.621630 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.624355 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.626124 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.627929 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.629799 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.632005 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.633914 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.635695 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.637555 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron.api.extensions [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Extended resource: tags {{(pid=108179) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 15 12:31:21.643551 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING keystonemiddleware.auth_token [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:31:21.648824 dv-cinder-803823-7-iscsi neutron-server[108179]: WARNING keystonemiddleware.auth_token [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:31:21.657786 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Acquired lock "singleton_lock" {{(pid=108179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 15 12:31:21.658253 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_concurrency.lockutils [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Releasing lock "singleton_lock" {{(pid=108179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 15 12:31:21.658894 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Starting 2 workers Nov 15 12:31:21.663710 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Started child 108286 {{(pid=108179) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 12:31:21.668086 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Started child 108287 {{(pid=108179) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 12:31:21.669172 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.669802 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO neutron.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 15 12:31:21.670307 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Publish callbacks [] for process, before_spawn {{(pid=108179) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.670629 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [-] (108286) wsgi starting up on http://0.0.0.0:9696 Nov 15 12:31:21.672749 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Starting 1 workers Nov 15 12:31:21.672870 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.674128 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [-] (108287) wsgi starting up on http://0.0.0.0:9696 Nov 15 12:31:21.677912 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Started child 108288 {{(pid=108179) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 12:31:21.678448 dv-cinder-803823-7-iscsi neutron-server[108179]: INFO oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Starting 1 workers Nov 15 12:31:21.681633 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] calling RpcWorker wait() {{(pid=108288) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 15 12:31:21.682192 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] returning from RpcWorker wait() {{(pid=108288) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 15 12:31:21.682843 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Started child 108289 {{(pid=108179) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 15 12:31:21.683534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.683627 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG neutron_lib.callbacks.manager [None req-cbdeb3b0-8743-4543-9028-cc741364a541 None None] Publish callbacks [] for process, after_spawn {{(pid=108179) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.684041 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:21.685523 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108179) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 15 12:31:21.685732 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:31:21.685917 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:31:21.686133 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:31:21.686436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:31:21.686608 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:31:21.687096 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.687370 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.687620 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.687833 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:21.688337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.688337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.688720 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.688981 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.689080 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:21.689218 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.689475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.689722 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.689887 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.690048 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.690287 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.690543 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.690842 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.691108 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.691362 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.691608 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.691778 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.692024 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.692315 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.692563 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.692816 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] debug = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.693062 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.694087 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.694321 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.694556 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.694766 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.695033 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.695261 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.695526 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.695747 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.695958 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.696217 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.696470 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.696696 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.696916 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.697171 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.697380 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.697626 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.697839 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.698283 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] host = dv-cinder-803823-7-iscsi {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.698497 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.698725 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.698946 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.699185 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.699427 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.699636 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.699881 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.700146 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.700407 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.700623 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.700860 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.701100 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.701314 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.701554 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.701703 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_options = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.701939 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.702203 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.702456 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.702650 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.702820 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.702970 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.703223 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.703370 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.703614 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.703837 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.704045 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.704275 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.704482 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.704723 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.704974 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.705196 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.705441 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.705664 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.705926 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.706148 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.706364 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.706604 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.706840 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.707050 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.707276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.707509 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.707706 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.707917 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.708184 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.708394 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.708643 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.708908 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.709703 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.709934 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.710184 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.710408 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.710630 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.710848 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.711123 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.711343 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.711646 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.711826 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.712037 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.712296 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.712504 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.712746 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.712971 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_json = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.713192 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.713402 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.713636 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.713847 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.714054 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.714260 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.714468 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.714710 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.715130 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.715415 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.715715 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.715963 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.716241 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.716476 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.716700 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.716930 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.717188 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.717429 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.717752 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.717967 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.718254 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.718485 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.718739 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.719057 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.719304 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.719575 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.719785 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.720011 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.720242 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.720458 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.720730 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.720969 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.721207 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.721431 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.721656 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.721995 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.722295 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.722531 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.44/identity {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.722880 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.722981 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.723177 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.723415 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.723627 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.723850 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.724057 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.724432 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.724707 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.725330 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.725330 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.725572 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.725655 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.725812 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.726061 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.726296 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.726543 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.726756 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.726968 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.727175 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.727383 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.727604 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.727831 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.728040 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.728291 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.728512 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.729123 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.729123 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.729282 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.729440 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732276 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732841 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732841 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.732841 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.733136 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.733233 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.736369 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.736747 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.737078 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.737443 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.737650 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.737954 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.738238 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.738520 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.738794 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.739037 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.739311 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.739476 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.739718 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.739996 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.740181 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.740520 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.740851 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.741114 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.741383 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.741624 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.741873 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.742107 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.742341 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.742580 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.742818 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.743030 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.743317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.743521 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.743749 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.743987 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.744245 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.744502 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.744717 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.744936 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.745170 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.745411 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.745638 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.745998 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.746225 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.746487 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.746718 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.746949 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.747230 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.747496 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.747768 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.748002 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.748296 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.749268 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.749554 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.749804 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.750214 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.750480 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.750750 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.750999 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.751247 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.751493 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753920 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.753920 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.754087 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.754356 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.754617 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.754853 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.755118 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.755360 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.755606 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.756390 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.756652 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.44/identity {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.756898 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.757137 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.757365 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.757574 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.757812 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.758058 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.758289 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.758518 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.758727 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.758977 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.759203 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.759441 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.759645 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.759860 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.760073 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.760337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.760544 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.760761 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.760989 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.761368 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.761730 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.762104 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.762457 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.762844 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.763221 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.763494 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.763751 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.763988 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.764238 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.764567 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.765158 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.765411 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.765658 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.766142 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.766388 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.766627 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.766846 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.767079 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.767292 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.767519 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.767750 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.768003 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.768334 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.768674 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.768912 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.769139 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.769385 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.769599 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.769846 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.770087 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.770335 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.770536 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.770749 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.770990 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.771227 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.771446 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.772275 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.772486 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.772721 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.772931 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.773167 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.773397 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.773689 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.773950 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.774185 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.774433 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.774668 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.774899 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.775124 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.775334 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.775540 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.775754 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.775971 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.776196 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.776570 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.776913 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.777311 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.777709 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.777982 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.778264 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.778773 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.778982 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.779191 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.779430 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.779648 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.779850 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.780269 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.780650 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.780889 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.781109 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.781344 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.781552 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.781776 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.781975 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.782318 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.782699 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.782921 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.783128 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.783424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.783672 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.783892 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.784200 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.784444 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.784699 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.784951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.785273 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.785485 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.785729 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.785946 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.786169 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.786408 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.786706 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.786971 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.787292 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.787555 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.788148 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.788148 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.788378 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.788573 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.788783 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792153 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.792833 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.793417 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.793417 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.793417 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.793609 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.793738 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:31:21.794262 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108179) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 15 12:31:21.794423 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:31:21.794576 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:31:21.794759 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:31:21.794931 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:31:21.795082 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:31:21.795288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.795449 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.795611 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.795774 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.795930 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796109 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796433 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796600 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796763 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.796907 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797062 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797216 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797371 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797526 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797681 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797835 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.797990 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.798214 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.798391 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.798543 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.798782 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.799027 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] debug = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.799192 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.799718 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.799889 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800047 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800241 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800395 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800534 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800673 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800811 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.800965 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801110 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801261 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801408 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801575 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801723 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.801884 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802033 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802188 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802324 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] host = dv-cinder-803823-7-iscsi {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802461 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802599 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802768 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.802966 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803141 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803296 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803428 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803558 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803708 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.803868 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804013 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804248 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804379 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804462 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804689 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_options = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804790 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.804896 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805046 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805237 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805556 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805711 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.805866 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806022 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806177 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806331 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806484 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806644 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806786 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.806940 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807083 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807241 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807401 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807528 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807681 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807834 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.807988 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808163 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808321 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808479 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808634 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808788 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.808943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809110 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809248 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809403 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809557 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809722 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.809859 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810013 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810167 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810323 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810477 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810636 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810791 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.810947 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811101 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811257 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811413 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811568 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811723 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.811877 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_json = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812032 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812209 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812364 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812507 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812662 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812816 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.812971 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.813125 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:31:21.813444 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.813611 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.813780 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.813940 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814125 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814259 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814413 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814570 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814728 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.814885 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815050 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815209 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815376 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815536 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815693 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.815853 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816011 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816191 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816351 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816508 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816672 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816832 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.816985 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817167 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817304 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817548 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817693 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817820 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.817947 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.818072 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.44/identity {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.818229 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.818898 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819043 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819212 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819397 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819626 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819626 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819851 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.819972 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820068 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820214 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820371 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820688 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820849 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.820991 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821143 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821313 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821467 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821615 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821747 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.821909 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822055 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822227 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822367 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822499 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822730 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:21.822879 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.822879 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823147 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823147 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823400 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823400 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823696 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823696 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823963 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.823963 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824259 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824393 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824527 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824662 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824795 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.824928 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825071 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825202 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825347 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825479 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825613 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825747 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.825878 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826033 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826193 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826351 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826509 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826652 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826812 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.826980 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827108 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827266 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827568 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827731 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.827894 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828051 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828229 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828387 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828544 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828702 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.828859 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829015 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829172 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829329 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829485 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829642 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829802 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.829960 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830116 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830273 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830428 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830585 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830740 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.830896 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831053 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831212 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831368 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831526 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831682 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.831838 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.832002 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.832180 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.832343 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.832502 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.832736 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.833691 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.833856 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.834066 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.834716 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.834876 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835105 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835231 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835562 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835687 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835810 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.835931 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836053 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836206 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836368 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836530 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836689 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.836869 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837026 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837189 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837348 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837505 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837955 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837955 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.837955 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838182 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838261 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838389 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838548 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.44/identity {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838706 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.838864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839021 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839178 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839337 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839486 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.839943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.840317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.840317 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.840787 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.840787 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.840787 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841149 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841149 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841149 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841491 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841491 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841721 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841721 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.841951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842082 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842201 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842321 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842445 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842567 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842994 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842994 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.842994 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.843943 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.844436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.844436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.844436 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.846211 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.847288 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.848864 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.850547 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.851424 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.852951 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853475 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.853986 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854458 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854458 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854458 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854666 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854666 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.854859 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855023 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855192 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855342 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855499 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855797 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.855896 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.856213 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.856315 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.856409 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.856612 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.856830 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857017 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857174 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857319 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857477 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857635 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.857793 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858178 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858178 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858416 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858521 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858603 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858776 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.858936 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859132 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859252 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859409 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859679 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859766 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.859857 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.860057 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.860229 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.860364 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:31:21.860540 dv-cinder-803823-7-iscsi neutron-server[108179]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:31:22.049228 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 44916) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:22.057768 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [-] 10.222.0.44 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0063834 Nov 15 12:31:33.379708 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6f2ff70-a672-486a-b6e5-9ba530fda39d None None] get_active_networks_info from dv-cinder-803823-7-iscsi {{(pid=108288) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 15 12:31:33.467802 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6f2ff70-a672-486a-b6e5-9ba530fda39d None None] No non-hosted networks {{(pid=108288) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 15 12:31:33.488986 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8cdc797a-d4f7-4d06-bb66-f2181906ef3c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:35.734477 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-403f6bc0-6c5e-42e2-8404-ae955539dd0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:35.784446 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-28127269-7eb0-42a1-adce-3cd2ec92cc61 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:36.874126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:38.326418 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:39.078476 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:39.079552 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.080153 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.080729 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.081251 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.081814 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.082333 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.082891 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.083441 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.084056 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.085121 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.085673 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.086234 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:39.086808 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-803823-7-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:39.094297 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-803823-7-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:31:39.435944 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.db.l3_hamode_db [None req-bb84777d-f879-4f7c-b8de-7e2984ca43f3 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 15 12:31:39.519700 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb84777d-f879-4f7c-b8de-7e2984ca43f3 None None] Routers set() bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:31:39.520111 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb84777d-f879-4f7c-b8de-7e2984ca43f3 None None] Router IDs set() for agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 15 12:31:39.760114 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 45008) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:40.266445 dv-cinder-803823-7-iscsi neutron-server[108286]: WARNING oslo_policy.policy [None req-4c57f998-a190-48bb-8b11-494cbc117838 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:40.267074 dv-cinder-803823-7-iscsi neutron-server[108286]: WARNING oslo_policy.policy [None req-4c57f998-a190-48bb-8b11-494cbc117838 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:40.497916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [None req-4c57f998-a190-48bb-8b11-494cbc117838 admin admin] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:31:40.499247 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4c57f998-a190-48bb-8b11-494cbc117838 admin admin] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7368293 Nov 15 12:31:43.028020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 45024) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:43.340502 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'shared': True, 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'default_prefixlen': 26}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:31:43.435996 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.policy [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108286) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 15 12:31:43.483181 dv-cinder-803823-7-iscsi neutron-server[108286]: WARNING oslo_policy.policy [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:43.483543 dv-cinder-803823-7-iscsi neutron-server[108286]: WARNING oslo_policy.policy [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:43.491957 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.quota [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] Loaded quota_driver: . Nov 15 12:31:43.579654 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064525430', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064526915', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064504892', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064508157', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064490208', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738064495469', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-32830083', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-32825116', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-460449', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-447074'] for rbac-policy, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:43.642485 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:43.643634 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8ed6621e-8ce6-4e8e-a19e-46746ed31fe5 admin admin] 10.222.0.44 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6143916 Nov 15 12:31:46.336472 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45036) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:46.818078 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING oslo_policy.policy [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:46.819164 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING oslo_policy.policy [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:47.044069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Request body: {'network': {'name': 'private', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'project_id': '0a32310cca2047d291d7371142620092'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:31:47.045629 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.quota [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Loaded quota_driver: . Nov 15 12:31:47.100163 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Made reservation on behalf of 0a32310cca2047d291d7371142620092 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:31:47.167405 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.policy [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108287) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 15 12:31:47.213595 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING oslo_policy.policy [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:47.213983 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING oslo_policy.policy [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 15 12:31:47.224332 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.245041 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.353693 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.358175 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.381373 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] vlan segment allocate from pool success with {'vlan_id': 645, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:31:47.407415 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8738060767169', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.407985 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Unsubscribe: segment precommit_create {{(pid=108287) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 15 12:31:47.408508 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Added segment cf44b921-1692-434d-a6e5-c6c1f6f2c5b5 of type vlan for network 1177070a-3013-4195-a2d1-ad5276b152fb Nov 15 12:31:47.414472 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=024dc45f-02b1-4031-88d8-dd620a43b081,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:31:47.435250 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.435604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.435935 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.436289 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.436607 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.436935 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.437253 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.437582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.437910 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.438223 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.438530 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.438834 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Tracked resource versions report: Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: pushed versions: Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: { 'AddressGroup': {'1.2'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'ConntrackHelper': {'1.0'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Log': {'1.0'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Network': {'1.1'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Port': {'1.7'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'PortForwarding': {'1.2'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'QosPolicy': {'1.10'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroup': {'1.5'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SubPort': {'1.0'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Subnet': {'1.1'}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Trunk': {'1.1'}} Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: consumer versions: Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'ConntrackHelper': '1.0', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Log': '1.0', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Network': '1.1', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Port': '1.7', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'PortForwarding': '1.2', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'QosPolicy': '1.10', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroup': '1.5', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroupRule': '1.2', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SubPort': '1.0', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Subnet': '1.1', Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Trunk': '1.1'}} Nov 15 12:31:47.439901 dv-cinder-803823-7-iscsi neutron-server[108287]: {{(pid=108287) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:31:47.524992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.564759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.565812 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:31:47.566538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:47.644726 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.3070450 Nov 15 12:31:47.672196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1ff61c-7a70-40bd-adf8-6071d6fed498 admin admin] Pushing event updated for resources: {'Network': ['ID=1177070a-3013-4195-a2d1-ad5276b152fb,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:31:47.684657 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 1177070a-3013-4195-a2d1-ad5276b152fb details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:31:50.413136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45058) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:50.790609 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6905a0e-c4e8-44b1-ad8a-c83361fd088f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:31:50.791983 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c6905a0e-c4e8-44b1-ad8a-c83361fd088f admin admin] 10.222.0.44 "GET /v2.0/networks/1177070a-3013-4195-a2d1-ad5276b152fb HTTP/1.1" status: 200 len: 825 time: 0.3779132 Nov 15 12:31:50.831610 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8d32e7dc-d797-406c-bd1c-fc38a6de874c admin admin] 10.222.0.44 "GET /v2.0/subnetpools/819645e8-2654-47c3-9a14-8cd7a7fd4a02 HTTP/1.1" status: 200 len: 734 time: 0.0333235 Nov 15 12:31:50.841450 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Request body: {'subnet': {'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:31:50.863188 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Made reservation on behalf of 0a32310cca2047d291d7371142620092 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:31:50.865922 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Publish callbacks [] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:51.145294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:51.210800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae1fa87e-97fe-4b1f-af5f-6ee8f4337403,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:31:51.215269 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Checking segment: {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:31:51.215659 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Network hostable DHCP agents. Network: 1177070a-3013-4195-a2d1-ad5276b152fb, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:31:51.235420 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Network 1177070a-3013-4195-a2d1-ad5276b152fb is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:31:51.246504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 1177070a-3013-4195-a2d1-ad5276b152fb) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:31:51.251623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:31:51.252265 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:51.257180 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-982e5729-0c84-4449-b4dc-9874e1647059 None None] Network 1177070a-3013-4195-a2d1-ad5276b152fb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:31:51.268636 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-ab78e49b-1012-434e-a215-749db49f0c3d admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4304740 Nov 15 12:31:51.577653 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-1177070a-3013-4195-a2d1-ad5276b152fb', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:31:51.578902 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:51.868363 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Allocated IP 172.20.0.2 (1177070a-3013-4195-a2d1-ad5276b152fb/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403/2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:31:52.069734 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:52.077856 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:52.151076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Network 1177070a-3013-4195-a2d1-ad5276b152fb is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:31:52.159428 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:31:52.165693 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Pushing event updated for resources: {'Port': ['ID=2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:31:52.167863 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:31:52.198967 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.199330 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.199674 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.200005 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.200364 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Tracked resource versions report: Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: pushed versions: Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: { 'AddressGroup': {'1.2'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'ConntrackHelper': {'1.0'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Log': {'1.0'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Network': {'1.1'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Port': {'1.7'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'PortForwarding': {'1.2'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'QosPolicy': {'1.10'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroup': {'1.5'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SubPort': {'1.0'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Subnet': {'1.1'}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Trunk': {'1.1'}} Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: consumer versions: Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'ConntrackHelper': '1.0', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Log': '1.0', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Network': '1.1', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Port': '1.7', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'PortForwarding': '1.2', Nov 15 12:31:52.203734 dv-cinder-803823-7-iscsi neutron-server[108288]: 'QosPolicy': '1.10', Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroup': '1.5', Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroupRule': '1.2', Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SubPort': '1.0', Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Subnet': '1.1', Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Trunk': '1.1'}} Nov 15 12:31:52.205207 dv-cinder-803823-7-iscsi neutron-server[108288]: {{(pid=108288) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:31:52.251721 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Attempting to bind port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:31:52.252114 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Attempting to bind port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:31:52.252554 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Attempting to bind port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce on network 1177070a-3013-4195-a2d1-ad5276b152fb {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:31:52.257331 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 31, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:31:52.257868 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Checking segment: {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:31:52.258167 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:52.258548 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Bound using segment: {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:31:52.259047 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Bound port: 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:31:52.259452 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:52.322006 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] For port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:31:52.326043 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] For port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce,segment=NetworkSegment(cf44b921-1692-434d-a6e5-c6c1f6f2c5b5),segment_id=cf44b921-1692-434d-a6e5-c6c1f6f2c5b5)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:31:52.330456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:31:52.395830 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d34f40-84cc-477e-a60d-28ff2cec8ae0 None None] Pushing event updated for resources: {'Port': ['ID=2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:31:53.831123 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45066) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:54.150986 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [None req-26cf3626-51d9-4d1a-bd44-ae0fdedbb6a5 admin admin] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:31:54.151976 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-26cf3626-51d9-4d1a-bd44-ae0fdedbb6a5 admin admin] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3197911 Nov 15 12:31:56.709479 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45074) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:31:57.024885 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [None req-9c23a4a5-2121-48b1-8056-c91c0868473f admin admin] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:31:57.025864 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9c23a4a5-2121-48b1-8056-c91c0868473f admin admin] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3154767 Nov 15 12:31:59.782008 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45084) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:00.079714 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '0a32310cca2047d291d7371142620092'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:32:00.104437 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:00.106142 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:00.248523 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:00.254171 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:00.269960 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:00.271148 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-96376eac-9e64-464b-b57f-e0f123d6b5da admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4881666 Nov 15 12:32:00.946265 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:32:01.036551 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:01.037642 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:01.152038 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:01.186534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce,segment=NetworkSegment(cf44b921-1692-434d-a6e5-c6c1f6f2c5b5),segment_id=cf44b921-1692-434d-a6e5-c6c1f6f2c5b5)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:32:01.192490 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:01.241068 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:01.569889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0d0b8a6-50d6-49f4-84bb-940c0dbc16d1 None None] Network 1177070a-3013-4195-a2d1-ad5276b152fb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:32:01.632421 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-c08f0978-2fb3-4261-9acc-c774f20e8aa7 None None] Provisioning complete for port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:01.632784 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c08f0978-2fb3-4261-9acc-c774f20e8aa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:01.980407 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-b3385445-85c1-4425-bce3-b965d93b7c56 None None] Provisioning complete for port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:01.981018 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b3385445-85c1-4425-bce3-b965d93b7c56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:02.799037 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45096) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:02.919145 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:32:02.964388 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:02.964749 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:03.106909 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [None req-f6c5cde7-aa45-4d0e-9691-6e21d5f015fc admin admin] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:32:03.107905 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f6c5cde7-aa45-4d0e-9691-6e21d5f015fc admin admin] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3079557 Nov 15 12:32:03.288515 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-37454c58-2f1a-4582-b3c0-0dab21fef371 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:05.623249 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45104) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:05.704722 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e534c194-07c1-4ccc-b741-d2fe7f539118 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:05.931304 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Request body: {'network': {'name': 'public', 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'provider:network_type': 'flat', 'is_default': True}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:32:05.952467 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Made reservation on behalf of 2031f4db42614bd2b93b3a9488865005 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:32:05.954639 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:05.962331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.031626 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.034871 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.051184 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Reserving flat network on physical network physnet1 {{(pid=108287) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 15 12:32:06.066991 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e8a3775-f2f9-46fe-a484-d88a83513954,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:06.072709 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.073049 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Added segment bf382968-1d0a-45d6-a42c-25204c795036 of type flat for network 45831433-abc0-4e27-bccd-5aeb94543032 Nov 15 12:32:06.126731 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.157080 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.157984 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:32:06.158571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:06.207463 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5831659 Nov 15 12:32:06.219718 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8772b5af-32a7-43a8-bf19-ecddb5794805 admin admin] Pushing event updated for resources: {'Network': ['ID=45831433-abc0-4e27-bccd-5aeb94543032,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:06.230232 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 45831433-abc0-4e27-bccd-5aeb94543032 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:32:06.798003 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:08.229975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:08.691541 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45122) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:08.869225 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-527e9a7e-8492-422b-9449-01d3fdf37f8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:32:08.870493 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-527e9a7e-8492-422b-9449-01d3fdf37f8f admin admin] 10.222.0.44 "GET /v2.0/subnets/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403 HTTP/1.1" status: 200 len: 849 time: 0.1779335 Nov 15 12:32:08.986950 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1bd1841c-f491-4ecc-9f94-47142cc40818 admin admin] 10.222.0.44 "GET /v2.0/routers/73b2ffd6-3d37-4288-aff3-4c766439bc68 HTTP/1.1" status: 200 len: 704 time: 0.1098080 Nov 15 12:32:09.069187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:09.251602 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:09.537927 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Allocated IP 172.20.0.1 (1177070a-3013-4195-a2d1-ad5276b152fb/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403/314b253b-b1ab-40a3-9626-2ba35c634514) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:32:09.729823 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:09.795140 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:09.863510 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Network 1177070a-3013-4195-a2d1-ad5276b152fb is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:32:09.870160 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:32:09.872801 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:32:09.873476 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:09.941886 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Pushing event updated for resources: {'Port': ['ID=314b253b-b1ab-40a3-9626-2ba35c634514,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:10.074317 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.118411 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-729255d1-b7f0-4343-bd4a-5c57279132df None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:10.119000 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-729255d1-b7f0-4343-bd4a-5c57279132df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.152911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-729255d1-b7f0-4343-bd4a-5c57279132df None None] Port 314b253b-b1ab-40a3-9626-2ba35c634514 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:32:10.277223 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.281751 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.282479 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.357136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Pushing event updated for resources: {'Port': ['ID=314b253b-b1ab-40a3-9626-2ba35c634514,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:10.403687 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Network 1177070a-3013-4195-a2d1-ad5276b152fb is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:32:10.405268 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:32:10.562571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Router 73b2ffd6-3d37-4288-aff3-4c766439bc68 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:32:10.574587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-6d2dfdd8-6341-4073-9669-37f4ac9812a5 None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:10.574956 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6d2dfdd8-6341-4073-9669-37f4ac9812a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:10.610841 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-6d2dfdd8-6341-4073-9669-37f4ac9812a5 None None] Port 314b253b-b1ab-40a3-9626-2ba35c634514 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:32:10.653882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:32:10.660102 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4dc3c42a-dee3-4357-af98-483be5600235 admin admin] 10.222.0.44 "PUT /v2.0/routers/73b2ffd6-3d37-4288-aff3-4c766439bc68/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.6668534 Nov 15 12:32:10.663848 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Sync routers for ids ['73b2ffd6-3d37-4288-aff3-4c766439bc68'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:32:10.676468 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Routers {'73b2ffd6-3d37-4288-aff3-4c766439bc68'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:32:10.677207 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:32:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['73b2ffd6-3d37-4288-aff3-4c766439bc68'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:10.863595 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Set router 73b2ffd6-3d37-4288-aff3-4c766439bc68 gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:32:11.286519 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:10Z', 'revision_number': 2, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port_host': None, '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:10Z', 'revision_number': 2, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:11.335999 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Checking router: 73b2ffd6-3d37-4288-aff3-4c766439bc68 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:32:11.336394 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Updating router 73b2ffd6-3d37-4288-aff3-4c766439bc68 port 314b253b-b1ab-40a3-9626-2ba35c634514 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:32:11.383744 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:11.902649 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:11.909768 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:11.997033 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Pushing event updated for resources: {'Port': ['ID=314b253b-b1ab-40a3-9626-2ba35c634514,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:12.007856 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.008242 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.008587 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.008924 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.009254 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.009584 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.009908 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.010234 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.010569 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.010890 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.011214 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.011529 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Tracked resource versions report: Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: pushed versions: Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: { 'AddressGroup': {'1.2'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'ConntrackHelper': {'1.0'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Log': {'1.0'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Network': {'1.1'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Port': {'1.7'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'PortForwarding': {'1.2'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'QosPolicy': {'1.10'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroup': {'1.5'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SubPort': {'1.0'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Subnet': {'1.1'}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Trunk': {'1.1'}} Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: consumer versions: Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'ConntrackHelper': '1.0', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Log': '1.0', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Network': '1.1', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Port': '1.7', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'PortForwarding': '1.2', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'QosPolicy': '1.10', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroup': '1.5', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroupRule': '1.2', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SubPort': '1.0', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Subnet': '1.1', Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Trunk': '1.1'}} Nov 15 12:32:12.012654 dv-cinder-803823-7-iscsi neutron-server[108289]: {{(pid=108289) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:32:12.092520 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Attempting to bind port 314b253b-b1ab-40a3-9626-2ba35c634514 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:32:12.092915 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Attempting to bind port 314b253b-b1ab-40a3-9626-2ba35c634514 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:32:12.093338 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Attempting to bind port 314b253b-b1ab-40a3-9626-2ba35c634514 on network 1177070a-3013-4195-a2d1-ad5276b152fb {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:32:12.098543 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 32, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:32:12.098964 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Checking segment: {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:32:12.099435 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.099816 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Bound using segment: {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:32:12.100363 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Bound port: 314b253b-b1ab-40a3-9626-2ba35c634514, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf44b921-1692-434d-a6e5-c6c1f6f2c5b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:32:12.100750 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.166136 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] For port 314b253b-b1ab-40a3-9626-2ba35c634514, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:32:12.186740 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] For port 314b253b-b1ab-40a3-9626-2ba35c634514, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=314b253b-b1ab-40a3-9626-2ba35c634514,segment=NetworkSegment(cf44b921-1692-434d-a6e5-c6c1f6f2c5b5),segment_id=cf44b921-1692-434d-a6e5-c6c1f6f2c5b5)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:32:12.192345 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.241352 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Routers {'73b2ffd6-3d37-4288-aff3-4c766439bc68'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:32:12.241874 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:32:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['73b2ffd6-3d37-4288-aff3-4c766439bc68'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:12.248336 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:12.249431 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.332818 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] Set router 73b2ffd6-3d37-4288-aff3-4c766439bc68 gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:32:12.335848 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.371379 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] For port 314b253b-b1ab-40a3-9626-2ba35c634514, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=314b253b-b1ab-40a3-9626-2ba35c634514,segment=NetworkSegment(cf44b921-1692-434d-a6e5-c6c1f6f2c5b5),segment_id=cf44b921-1692-434d-a6e5-c6c1f6f2c5b5)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:32:12.381123 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.416542 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3da604-7702-431a-ac17-4af205e45e72 None None] Pushing event updated for resources: {'Port': ['ID=314b253b-b1ab-40a3-9626-2ba35c634514,revision_number=4']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:12.442096 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6395533c-beab-4825-8e63-078bacc6a884 None None] Pushing event updated for resources: {'Port': ['ID=314b253b-b1ab-40a3-9626-2ba35c634514,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:12.504905 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-9c9f3caf-096f-4444-9d3b-09e79bf64dbb None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:12.505243 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9c9f3caf-096f-4444-9d3b-09e79bf64dbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:12.557618 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:10Z', 'revision_number': 2, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port_host': None, '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:12Z', 'revision_number': 4, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:12.587530 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a42eed-0b42-4364-9dfb-68c64b38bceb None None] The sync data for ids ['73b2ffd6-3d37-4288-aff3-4c766439bc68'] in dv-cinder-803823-7-iscsi is: [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:10Z', 'revision_number': 2, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port_host': None, '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:12Z', 'revision_number': 4, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:32:13.043739 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45142) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:13.149600 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9626362a-2320-4f92-9cac-7046b3293302 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:32:13.150860 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9626362a-2320-4f92-9cac-7046b3293302 admin admin] 10.222.0.44 "GET /v2.0/networks/45831433-abc0-4e27-bccd-5aeb94543032 HTTP/1.1" status: 200 len: 842 time: 0.1060898 Nov 15 12:32:13.161031 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Request body: {'subnet': {'cidr': '172.27.0.0/24', 'name': 'public-subnet', 'gateway_ip': '172.27.0.1', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:32:13.183866 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Made reservation on behalf of 2031f4db42614bd2b93b3a9488865005 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:32:13.186085 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:13.527282 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.objects.ports [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=108287) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 15 12:32:13.527696 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:13.587565 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f0a0a193-a36f-4db1-9bc0-b984b6129445,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:13.591679 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:32:13.592025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Network hostable DHCP agents. Network: 45831433-abc0-4e27-bccd-5aeb94543032, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:32:13.608170 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:32:13.618032 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 45831433-abc0-4e27-bccd-5aeb94543032) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:32:13.622141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:32:13.622759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:13.629165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a08edce-41cf-4a36-a4bc-9010874db322 None None] Network 45831433-abc0-4e27-bccd-5aeb94543032 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:32:13.640341 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9af7db78-9fd7-4b84-a061-b1c9443a1912 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4825923 Nov 15 12:32:13.770028 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16cb1b5b-207f-4ba2-97c2-5283e11fed81 None None] Network 45831433-abc0-4e27-bccd-5aeb94543032 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:32:15.741570 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:32:16.071986 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45150) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:16.205736 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-74752442-8863-4a17-ae6c-3b84acdeda0b admin admin] 10.222.0.44 "GET /v2.0/routers/73b2ffd6-3d37-4288-aff3-4c766439bc68 HTTP/1.1" status: 200 len: 710 time: 0.1297505 Nov 15 12:32:16.291259 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-935aecf9-8c3d-4326-b0e7-4a2659863fd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:32:16.292594 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-935aecf9-8c3d-4326-b0e7-4a2659863fd0 admin admin] 10.222.0.44 "GET /v2.0/networks/45831433-abc0-4e27-bccd-5aeb94543032 HTTP/1.1" status: 200 len: 886 time: 0.0862002 Nov 15 12:32:16.302205 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:32:16.548959 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:16.780552 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:16.853653 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:16.959465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Allocated IP 172.27.0.126 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/40ab61f0-1330-48b2-8f4a-1f5f7d773a5a) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:32:17.059100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.093739 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.132982 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:32:17.135652 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:32:17.139148 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:32:17.171320 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Pushing event updated for resources: {'Port': ['ID=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:17.457402 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.649869 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-33113136', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-33079231', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-1021'] for router, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.653060 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-33113135', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-33113126', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-33079222'] for router, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.757376 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Router 73b2ffd6-3d37-4288-aff3-4c766439bc68 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:32:17.861838 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:32:17.866740 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:17.868040 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9551b92b-b1c7-469f-911b-06a7b4c88cfb admin admin] 10.222.0.44 "PUT /v2.0/routers/73b2ffd6-3d37-4288-aff3-4c766439bc68 HTTP/1.1" status: 200 len: 890 time: 1.5692101 Nov 15 12:32:18.954087 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 314b253b-b1ab-40a3-9626-2ba35c634514 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:32:19.007149 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:19.007544 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:19.535822 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Sync routers for ids ['73b2ffd6-3d37-4288-aff3-4c766439bc68'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:32:19.547361 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Routers {'73b2ffd6-3d37-4288-aff3-4c766439bc68'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:32:19.547981 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:32:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['73b2ffd6-3d37-4288-aff3-4c766439bc68'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:19.751994 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Set router 73b2ffd6-3d37-4288-aff3-4c766439bc68 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:32:20.204754 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126'}], 'enable_snat': True}, 'gw_port_id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:17Z', 'revision_number': 4, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port': {'id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:3c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:16Z', 'updated_at': '2021-11-15T12:32:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:12Z', 'revision_number': 5, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:20.258766 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Checking router: 73b2ffd6-3d37-4288-aff3-4c766439bc68 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:32:20.259356 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Updating router 73b2ffd6-3d37-4288-aff3-4c766439bc68 port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:32:20.307104 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.382948 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45162) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:32:20.493699 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-352ad1c6-b82d-4c55-acb4-567021436925 admin admin] 10.222.0.44 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1096020 Nov 15 12:32:20.630919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.637021 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.689711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Attempting to bind port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:32:20.690079 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Attempting to bind port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:32:20.690434 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Attempting to bind port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:32:20.697526 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4368964-83a3-4a68-97d5-39b926268c31 None None] Pushing event updated for resources: {'Port': ['ID=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:20.700232 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 32, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:32:20.700598 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:32:20.700952 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.701323 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:32:20.701782 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Bound port: 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:32:20.702171 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.754101 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] For port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:32:20.756997 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] For port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:32:20.761925 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:20.820190 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4368964-83a3-4a68-97d5-39b926268c31 None None] Pushing event updated for resources: {'Port': ['ID=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:20.822999 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Routers {'73b2ffd6-3d37-4288-aff3-4c766439bc68'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:32:20.823581 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:32:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['73b2ffd6-3d37-4288-aff3-4c766439bc68'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:20.929697 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] Set router 73b2ffd6-3d37-4288-aff3-4c766439bc68 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:32:21.136634 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126'}], 'enable_snat': True}, 'gw_port_id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:17Z', 'revision_number': 4, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port': {'id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:3c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:16Z', 'updated_at': '2021-11-15T12:32:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:12Z', 'revision_number': 5, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:32:21.166285 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8669e207-87ad-439c-9fca-b16ab1ed2d0a None None] The sync data for ids ['73b2ffd6-3d37-4288-aff3-4c766439bc68'] in dv-cinder-803823-7-iscsi is: [{'id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'name': 'router1', 'tenant_id': '0a32310cca2047d291d7371142620092', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126'}], 'enable_snat': True}, 'gw_port_id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:32:00Z', 'updated_at': '2021-11-15T12:32:17Z', 'revision_number': 4, 'project_id': '0a32310cca2047d291d7371142620092', 'gw_port': {'id': '40ab61f0-1330-48b2-8f4a-1f5f7d773a5a', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:3c:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:16Z', 'updated_at': '2021-11-15T12:32:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '314b253b-b1ab-40a3-9626-2ba35c634514', 'name': '', 'network_id': '1177070a-3013-4195-a2d1-ad5276b152fb', 'tenant_id': '0a32310cca2047d291d7371142620092', 'mac_address': 'fa:16:3e:90:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73b2ffd6-3d37-4288-aff3-4c766439bc68', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:32:09Z', 'updated_at': '2021-11-15T12:32:12Z', 'revision_number': 5, 'project_id': '0a32310cca2047d291d7371142620092', 'subnets': [{'id': 'ae1fa87e-97fe-4b1f-af5f-6ee8f4337403', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '819645e8-2654-47c3-9a14-8cd7a7fd4a02'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:32:22.980031 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:32:23.030609 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:23.030975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:23.115526 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:23.139681 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:32:23.143686 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:23.214252 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=40ab61f0-1330-48b2-8f4a-1f5f7d773a5a,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:32:24.939332 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:32:25.006931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 40ab61f0-1330-48b2-8f4a-1f5f7d773a5a triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:32:25.007305 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:33.291853 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c9516bb7-2c61-40c4-b572-90f62243aefa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:35.713544 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2eb4d90a-f774-427e-b50e-98db112467e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:36.809667 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:38.235512 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:39.073872 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:32:52.742658 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:33:03.308392 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1e783271-1520-430e-86e7-af964aff5944 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:05.708904 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-908febae-6354-4e4f-b328-1e390f9fdefc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:06.799331 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:08.240976 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:09.078887 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:29.741531 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:33:33.290701 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a04d5886-b584-4733-91bc-bf82f77168db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:35.713075 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b725d3dd-d982-4859-8de4-0f56e06e32e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:36.791318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:38.240702 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:39.084594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:33:58.151280 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 45724) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:33:58.232765 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0f1fbb1-6c15-4947-92e7-fe4f8b6ec308 admin admin] GET failed (client error): The resource could not be found. Nov 15 12:33:58.234149 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a0f1fbb1-6c15-4947-92e7-fe4f8b6ec308 admin admin] 10.222.0.44 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0819535 Nov 15 12:33:58.427393 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a16dcf9b-6d25-450b-be6d-e956d6ffc209 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:33:58.428869 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a16dcf9b-6d25-450b-be6d-e956d6ffc209 admin admin] 10.222.0.44 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1894896 Nov 15 12:34:00.725658 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45734) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:00.816416 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edca41e5-394c-426a-bfdb-a943a83d6581 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:00.817746 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-edca41e5-394c-426a-bfdb-a943a83d6581 admin admin] 10.222.0.44 "GET /v2.0/subnets/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403 HTTP/1.1" status: 200 len: 849 time: 0.0911553 Nov 15 12:34:00.827534 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:34:00.907581 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Publish callbacks [] for subnet, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:01.044211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8738060695974'] for subnet, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:01.071275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:01.071890 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:01.092157 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] 10.222.0.44 "PUT /v2.0/subnets/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403 HTTP/1.1" status: 200 len: 868 time: 0.2492528 Nov 15 12:34:01.092388 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae89fcd0-b621-4354-a650-4573b2bf5f16 None None] Network 1177070a-3013-4195-a2d1-ad5276b152fb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae1fa87e-97fe-4b1f-af5f-6ee8f4337403,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.108147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0929a-4062-4b6b-b03a-b954acd1a21d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:01.408888 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e155aeb4-8a55-45af-a8f5-4947c589b0a3 None None] Provisioning complete for port 314b253b-b1ab-40a3-9626-2ba35c634514 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:34:01.409249 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e155aeb4-8a55-45af-a8f5-4947c589b0a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:01.491602 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e155aeb4-8a55-45af-a8f5-4947c589b0a3 None None] Provisioning complete for port 2aea5a97-4ae5-4ea5-85f7-c52dbd27e8ce triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:34:01.491960 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e155aeb4-8a55-45af-a8f5-4947c589b0a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:03.292996 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2e6cfcae-e484-4dd0-bed6-45ed3a826c5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:03.376949 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45744) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:03.571600 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e09a251-5889-4fb7-8e89-479f80e808de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:03.572077 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e09a251-5889-4fb7-8e89-479f80e808de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:03.573614 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5e09a251-5889-4fb7-8e89-479f80e808de admin admin] 10.222.0.44 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1956983 Nov 15 12:34:05.713819 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0d49600b-e235-4fe2-b3f4-a25c3e3c4bca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:05.885348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45752) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:06.014665 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2f0d45d-b85a-41a2-80b6-b1584d6232c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:06.015143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2f0d45d-b85a-41a2-80b6-b1584d6232c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:06.016676 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a2f0d45d-b85a-41a2-80b6-b1584d6232c0 admin admin] 10.222.0.44 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1303844 Nov 15 12:34:06.739783 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:34:06.795486 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:08.244263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:08.337817 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45760) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:08.469689 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-011fd70e-ad23-43e1-abd1-6cacc2f08120 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:08.470941 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-011fd70e-ad23-43e1-abd1-6cacc2f08120 admin admin] 10.222.0.44 "GET /v2.0/networks/1177070a-3013-4195-a2d1-ad5276b152fb HTTP/1.1" status: 200 len: 869 time: 0.1322002 Nov 15 12:34:09.086670 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:10.788913 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45768) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:10.911975 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7ccb365-c5ce-470f-94f0-488c3db8a079 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:10.913396 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b7ccb365-c5ce-470f-94f0-488c3db8a079 admin admin] 10.222.0.44 "GET /v2.0/networks/45831433-abc0-4e27-bccd-5aeb94543032 HTTP/1.1" status: 200 len: 886 time: 0.1235328 Nov 15 12:34:13.200195 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45776) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:13.321904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb846cfd-6d89-4577-8efc-ca72c81c8d6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:13.322355 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb846cfd-6d89-4577-8efc-ca72c81c8d6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:13.323840 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-eb846cfd-6d89-4577-8efc-ca72c81c8d6f admin admin] 10.222.0.44 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1227510 Nov 15 12:34:15.651697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45784) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:15.740106 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f640887e-0fd9-452d-bc4f-a644e77c3d1a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:15.740579 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f640887e-0fd9-452d-bc4f-a644e77c3d1a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:15.742034 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f640887e-0fd9-452d-bc4f-a644e77c3d1a admin admin] 10.222.0.44 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0893383 Nov 15 12:34:18.028579 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45792) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:18.215255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67b1395f-85df-41f7-989c-b053211d0da8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:18.216556 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-67b1395f-85df-41f7-989c-b053211d0da8 admin admin] 10.222.0.44 "GET /v2.0/subnets/ae1fa87e-97fe-4b1f-af5f-6ee8f4337403 HTTP/1.1" status: 200 len: 868 time: 0.1870399 Nov 15 12:34:20.515744 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45800) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:20.598961 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc6f2a8a-80e8-40f4-bf00-0c5f6ac918ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:20.600292 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bc6f2a8a-80e8-40f4-bf00-0c5f6ac918ef admin admin] 10.222.0.44 "GET /v2.0/subnets/f0a0a193-a36f-4db1-9bc0-b984b6129445 HTTP/1.1" status: 200 len: 816 time: 0.0835633 Nov 15 12:34:33.294589 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c6dd2cf5-b407-4ecc-a8bf-bb6970675d7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:35.717617 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-dcc07b89-1505-4119-89fb-b943d9e0cb9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:36.801633 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:38.247781 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:39.087541 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:43.741059 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:34:45.096915 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45856) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:45.149623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [None req-e67800f9-fecd-48a4-a719-e1adfbc3fefe admin admin] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:34:45.150614 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e67800f9-fecd-48a4-a719-e1adfbc3fefe admin admin] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0527656 Nov 15 12:34:47.523682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45864) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:47.582906 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.pecan_wsgi.hooks.translation [None req-17c683c3-4c64-49a0-b993-187f23a9c3db admin admin] GET failed (client error): The resource could not be found. Nov 15 12:34:47.584197 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-17c683c3-4c64-49a0-b993-187f23a9c3db admin admin] 10.222.0.44 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0595274 Nov 15 12:34:47.720763 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feea87a6-47ed-464f-a4bb-436b6649f832 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:47.722240 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-feea87a6-47ed-464f-a4bb-436b6649f832 admin admin] 10.222.0.44 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1334782 Nov 15 12:34:50.026067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45872) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:50.072245 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:34:50.092630 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Made reservation on behalf of 2031f4db42614bd2b93b3a9488865005 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:34:50.095181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:50.124596 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING neutron.services.revisions.revision_plugin [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Could not find related network for resource to bump revision. Nov 15 12:34:50.136471 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] vlan segment allocate from pool success with {'vlan_id': 643, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:34:50.145425 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:50.145753 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Added segment 43629f4a-6f55-4bf8-a7d1-29c54ac0908c of type vlan for network b250e66d-1b8b-40c2-ac35-c8944138dc77 Nov 15 12:34:50.183371 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:50.207149 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:50.208170 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:50.208736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:50.255559 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2283354 Nov 15 12:34:50.267299 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42dc9165-a1da-4d13-be94-cc6792bf896e admin admin] Pushing event updated for resources: {'Network': ['ID=b250e66d-1b8b-40c2-ac35-c8944138dc77,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:50.278445 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:34:52.592820 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45880) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:34:52.652223 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.pecan_wsgi.hooks.translation [None req-35e157a0-b50a-4adf-adc6-5a237ab20526 admin admin] GET failed (client error): The resource could not be found. Nov 15 12:34:52.653465 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-35e157a0-b50a-4adf-adc6-5a237ab20526 admin admin] 10.222.0.44 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0597100 Nov 15 12:34:52.723521 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b7ed8d-25a4-4205-b1a9-cb929e8e9755 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:52.724960 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e4b7ed8d-25a4-4205-b1a9-cb929e8e9755 admin admin] 10.222.0.44 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0667226 Nov 15 12:34:52.734973 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Request body: {'subnet': {'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77', 'ip_version': 4, 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:34:52.754538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Made reservation on behalf of 2031f4db42614bd2b93b3a9488865005 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:34:52.757673 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Publish callbacks [] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:52.912974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:52.968461 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Pushing event updated for resources: {'Subnet': ['ID=61d8a135-46cf-41e5-8b91-ce7b3ab5a44c,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:52.972602 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Checking segment: {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:34:52.972955 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Network hostable DHCP agents. Network: b250e66d-1b8b-40c2-ac35-c8944138dc77, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:34:52.987837 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:34:52.996050 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, b250e66d-1b8b-40c2-ac35-c8944138dc77) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:34:52.999906 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:34:53.000537 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.005179 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e2c48a0-d3e8-49e2-9ccf-c7c27b88aabd None None] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:34:53.015858 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c6a7d5bc-0808-450e-842e-48b99c46bc5d admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2841177 Nov 15 12:34:53.248156 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-b250e66d-1b8b-40c2-ac35-c8944138dc77', 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77', 'tenant_id': '2031f4db42614bd2b93b3a9488865005', 'fixed_ips': [{'subnet_id': '61d8a135-46cf-41e5-8b91-ce7b3ab5a44c'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:34:53.249041 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.384723 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Allocated IP 192.168.233.2 (b250e66d-1b8b-40c2-ac35-c8944138dc77/61d8a135-46cf-41e5-8b91-ce7b3ab5a44c/0c5bde82-185d-452d-ac3b-76ec64ec397e) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:34:53.525928 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.532965 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.572727 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:34:53.575522 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:34:53.579091 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:34:53.585752 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Pushing event updated for resources: {'Port': ['ID=0c5bde82-185d-452d-ac3b-76ec64ec397e,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:53.595360 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.596237 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.596594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.596929 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.597257 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.597580 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.597900 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.598221 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.598558 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.598877 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.599194 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.599506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:34:53.643614 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Attempting to bind port 0c5bde82-185d-452d-ac3b-76ec64ec397e on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:34:53.643976 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Attempting to bind port 0c5bde82-185d-452d-ac3b-76ec64ec397e by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:34:53.644368 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Attempting to bind port 0c5bde82-185d-452d-ac3b-76ec64ec397e on network b250e66d-1b8b-40c2-ac35-c8944138dc77 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:34:53.649281 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 34, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:34:53.649641 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Checking segment: {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:34:53.650033 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.650415 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Bound using segment: {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:34:53.650873 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Bound port: 0c5bde82-185d-452d-ac3b-76ec64ec397e, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:34:53.651259 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.715457 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] For port 0c5bde82-185d-452d-ac3b-76ec64ec397e, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:34:53.718716 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] For port 0c5bde82-185d-452d-ac3b-76ec64ec397e, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=0c5bde82-185d-452d-ac3b-76ec64ec397e,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:34:53.723300 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:53.783177 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb43114-1436-45ca-9c74-68494861bcf9 None None] Pushing event updated for resources: {'Port': ['ID=0c5bde82-185d-452d-ac3b-76ec64ec397e,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:54.573109 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19445567-64df-4b77-b0af-287d946b39da None None] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:34:54.699452 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] Provisioning complete for port 0c5bde82-185d-452d-ac3b-76ec64ec397e triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:34:54.699839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:54.805844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:54.843525 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] For port 0c5bde82-185d-452d-ac3b-76ec64ec397e, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=0c5bde82-185d-452d-ac3b-76ec64ec397e,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:34:54.848159 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:54.900582 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa539e5-65d7-4263-9999-e2b4cdd00ce7 None None] Pushing event updated for resources: {'Port': ['ID=0c5bde82-185d-452d-ac3b-76ec64ec397e,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:34:54.969306 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-dc1efe17-7f7f-4312-8482-2b803eacac8a None None] Provisioning complete for port 0c5bde82-185d-452d-ac3b-76ec64ec397e triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:34:54.970645 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-dc1efe17-7f7f-4312-8482-2b803eacac8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:34:55.053433 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 0c5bde82-185d-452d-ac3b-76ec64ec397e up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:34:55.105590 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 0c5bde82-185d-452d-ac3b-76ec64ec397e triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:34:55.105956 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:03.297373 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-179e22f9-6ca5-43b0-8311-46da8a829504 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:05.719247 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-280642b3-8112-434f-afc6-e69081075dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:06.800778 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:08.253503 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:09.089971 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:20.739725 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:35:33.300974 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d9e2529f-df96-4153-b195-21a643b1acb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:35.720231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d88c9041-0e03-4ce3-bce0-fb0189db92a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:36.806779 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:38.256577 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:39.093788 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:35:57.738245 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:36:03.303367 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f38ef0f5-4fa4-42a7-af70-c524fd5442f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:04.350715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45924) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:36:04.356483 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [None req-a9cf0d77-4a55-4f0c-9c60-5e0db6ef75e6 tempest-verify_tempest_config-1228035984 tempest-verify_tempest_config-1228035984-project] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:36:04.357497 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a9cf0d77-4a55-4f0c-9c60-5e0db6ef75e6 tempest-verify_tempest_config-1228035984 tempest-verify_tempest_config-1228035984-project] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058029 Nov 15 12:36:04.644867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 45942) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:36:04.744768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:04.817735 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:04.821891 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:04.865228 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=94d623fca51d468cb9a5152f13ed822a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2193465 Nov 15 12:36:04.866030 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7df99637-c37d-4db9-9c3b-d56d14572ac6,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:36:04.868068 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 45946) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:36:04.872481 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.872843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.873185 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.873513 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.873837 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.874163 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.874486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.874806 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.875129 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.875952 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.876291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.876607 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cb9cc54-6282-4ea6-b44d-739860646144 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:04.953464 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:04.973719 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:05.061981 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:05.064627 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:05.068454 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7df99637-c37d-4db9-9c3b-d56d14572ac6 HTTP/1.1" status: 204 len: 168 time: 0.1987936 Nov 15 12:36:05.076086 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7df99637-c37d-4db9-9c3b-d56d14572ac6,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:36:05.084555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.084906 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.085241 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.085575 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.085903 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.086232 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.086556 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.086892 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.087232 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.087560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.087919 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.088226 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70a76ada-57d5-4644-b24b-b2708483492e admin admin] Tracked resource versions report: Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: pushed versions: Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: { 'AddressGroup': {'1.2'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'ConntrackHelper': {'1.0'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Log': {'1.0'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Network': {'1.1'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Port': {'1.7'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'PortForwarding': {'1.2'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'QosPolicy': {'1.10'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroup': {'1.5'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SubPort': {'1.0'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Subnet': {'1.1'}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Trunk': {'1.1'}} Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: consumer versions: Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'ConntrackHelper': '1.0', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Log': '1.0', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Network': '1.1', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Port': '1.7', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'PortForwarding': '1.2', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'QosPolicy': '1.10', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroup': '1.5', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroupRule': '1.2', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SubPort': '1.0', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Subnet': '1.1', Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Trunk': '1.1'}} Nov 15 12:36:05.089264 dv-cinder-803823-7-iscsi neutron-server[108286]: {{(pid=108286) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:36:05.721565 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1dc72b5-796e-4033-94eb-1fe49744b283 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:06.807763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:08.260753 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:09.095053 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:33.304713 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-074a2246-104f-4a2e-95ee-2a259fe1b479 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:34.737029 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:36:35.722184 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e3493e58-c477-4008-851a-c5ade77f00a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:36.810691 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:38.263594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:36:39.095839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:03.306660 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b5fcae3e-c570-4c68-8985-84754242c73f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:05.724653 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ccba5b7b-403f-4bb2-85b4-46e7a7c13cf6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:06.817741 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:08.267535 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:09.099295 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:11.736375 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 5 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:37:33.311460 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-806ad0d5-c45f-47af-96e7-72d3416dcad5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:35.735166 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3081e936-f2b6-4fd9-81da-49ff0946e101 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:36.819627 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:38.272635 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:39.110403 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:42.061897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-33077542'] for agent, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:37:48.736253 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:37:57.546498 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46024) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:37:57.648127 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-b88efadd-37c9-4ad5-b17e-c573244a32ba admin admin] 10.222.0.44 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1005495 Nov 15 12:37:59.978642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46034) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:38:00.032412 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6fde07d5-978d-4ba7-aab0-ab6f29ca3ee2 admin admin] 10.222.0.44 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0522404 Nov 15 12:38:03.316043 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-eee40689-a64b-4adb-bf3b-af3e188fe233 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:05.730707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-53010d59-335b-41db-899c-7c856a5fd35c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:06.819664 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:08.279854 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:09.102946 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:12.037658 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:25.735434 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:38:33.318902 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-23a39be7-ad76-44b4-87f1-ac95d61b7a08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:35.732304 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e241c37f-8579-4451-a882-aad03082112c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:36.826386 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:38.278649 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:39.104977 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:38:42.034903 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:02.734716 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:39:03.322753 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-24578f5d-b99d-499e-9d72-9ea74f4a4cb5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:05.733188 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-56088d21-3abd-4d6e-bdcb-8366f41f4de5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:06.825438 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:08.280237 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:09.106924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:12.033524 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:30.914505 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46230) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.286064 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1656889266-network', 'tenant_id': 'b6483280ad224deba52ad37834829ec4'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:31.309335 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Made reservation on behalf of b6483280ad224deba52ad37834829ec4 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:31.311878 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.320807 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.374203 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46258) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.401496 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.405565 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.435052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] vlan segment allocate from pool success with {'vlan_id': 627, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:31.441946 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6d48c5d-c1f2-424f-8ea3-f44d72263c61,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:31.450713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.451072 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.451364 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.451745 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.452036 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.452524 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.453159 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.453294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.453853 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.454184 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.454509 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.454826 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Tracked resource versions report: Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: pushed versions: Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: { 'AddressGroup': {'1.2'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'ConntrackHelper': {'1.0'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Log': {'1.0'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Network': {'1.1'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Port': {'1.7'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'PortForwarding': {'1.2'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'QosPolicy': {'1.10'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroup': {'1.5'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SubPort': {'1.0'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Subnet': {'1.1'}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Trunk': {'1.1'}} Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: consumer versions: Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: HyperV agent@hv-cinder-80382: {}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'ConntrackHelper': '1.0', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Log': '1.0', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Network': '1.1', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Port': '1.7', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'PortForwarding': '1.2', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'QosPolicy': '1.10', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroup': '1.5', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SecurityGroupRule': '1.2', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'SubPort': '1.0', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Subnet': '1.1', Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: 'Trunk': '1.1'}} Nov 15 12:39:31.455884 dv-cinder-803823-7-iscsi neutron-server[108287]: {{(pid=108287) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:39:31.462455 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.463082 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Added segment d4dbcd66-07b0-40f5-b9ad-d07882cd268d of type vlan for network 94a77a43-b48f-41e8-ab85-fcd5736ca725 Nov 15 12:39:31.466138 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46264) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.515882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.546165 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.547115 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:31.547711 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.577914 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46274) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.600897 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.6852887 Nov 15 12:39:31.603958 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46278) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.610938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Request body: {'subnet': {'network_id': '94a77a43-b48f-41e8-ab85-fcd5736ca725', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1656889266-subnet', 'tenant_id': 'b6483280ad224deba52ad37834829ec4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:31.614621 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8670d43b-697d-4a77-8f87-ccdf74edbe60 admin admin] Pushing event updated for resources: {'Network': ['ID=94a77a43-b48f-41e8-ab85-fcd5736ca725,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:31.631212 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 94a77a43-b48f-41e8-ab85-fcd5736ca725 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:31.698550 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46280) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:31.717049 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Made reservation on behalf of b6483280ad224deba52ad37834829ec4 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:31.720481 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Publish callbacks [] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:31.888281 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1743657235-network', 'tenant_id': '27402858adce449996a04024b968bae3'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:31.916875 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-351123365-network', 'tenant_id': '9273dacda2824318a7e6d2acf9f295ba'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:31.971706 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:31.975055 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.005056 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Made reservation on behalf of 9273dacda2824318a7e6d2acf9f295ba for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:32.006299 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-network', 'tenant_id': '71e17179085148bfacb8d235fc6ee668'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:32.007585 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.029375 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.034718 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-network', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:32.041042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Made reservation on behalf of 71e17179085148bfacb8d235fc6ee668 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:32.043583 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.044331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.071692 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.170562 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.175358 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.239098 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] vlan segment allocate from pool success with {'vlan_id': 641, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:32.252844 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.253363 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Added segment 5488729b-f428-45a7-86f4-5ade62111aad of type vlan for network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 Nov 15 12:39:32.260930 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Made reservation on behalf of 5e23e880e5674cdb85e83c616f14f549 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:32.263298 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.305953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.337314 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14a775be-d3a6-41f0-89a6-aa9e22446e2e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:32.343587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.345465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:32.346176 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.347807 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.373378 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.391075 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.410487 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] vlan segment allocate from pool success with {'vlan_id': 647, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:32.426490 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8738060767169', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.427256 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Unsubscribe: segment precommit_create {{(pid=108286) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 15 12:39:32.427985 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Added segment d9fc4f19-bcef-4f65-b755-b74ba49c22d2 of type vlan for network e836cde6-4e01-43bc-9750-09587b9bb5d0 Nov 15 12:39:32.435594 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.7398810 Nov 15 12:39:32.439341 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46316) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:32.475956 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6074f50c-78c6-4931-a525-0e6079898dec,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:32.477252 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ee8c6d-564a-4863-bab1-e59ae6acdc18 admin admin] Pushing event updated for resources: {'Network': ['ID=4a1ca915-de15-4ccc-96e8-10f04d0723e3,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:32.479247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.492209 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Request body: {'subnet': {'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-subnet', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:32.495634 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:32.508781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.509121 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.509632 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.510192 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.510693 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.511205 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.511698 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.512223 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.512718 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.513202 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.514542 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.515031 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Tracked resource versions report: Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: pushed versions: Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: { 'AddressGroup': {'1.2'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'ConntrackHelper': {'1.0'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Log': {'1.0'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Network': {'1.1'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Port': {'1.7'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'PortForwarding': {'1.2'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'QosPolicy': {'1.10'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroup': {'1.5'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SubPort': {'1.0'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Subnet': {'1.1'}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Trunk': {'1.1'}} Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: consumer versions: Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: HyperV agent@hv-cinder-80382: {}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'ConntrackHelper': '1.0', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Log': '1.0', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Network': '1.1', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Port': '1.7', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'PortForwarding': '1.2', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'QosPolicy': '1.10', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroup': '1.5', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SecurityGroupRule': '1.2', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'SubPort': '1.0', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Subnet': '1.1', Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: 'Trunk': '1.1'}} Nov 15 12:39:32.516313 dv-cinder-803823-7-iscsi neutron-server[108286]: {{(pid=108286) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:39:32.674485 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.723156 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Checking segment: {'id': 'd4dbcd66-07b0-40f5-b9ad-d07882cd268d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '94a77a43-b48f-41e8-ab85-fcd5736ca725'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:32.723877 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Network hostable DHCP agents. Network: 94a77a43-b48f-41e8-ab85-fcd5736ca725, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:32.774192 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Made reservation on behalf of 71e17179085148bfacb8d235fc6ee668 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:32.776479 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.786118 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Pushing event updated for resources: {'Subnet': ['ID=7fada893-d8c0-485f-b929-6d777a0d0bb7,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:32.881158 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.886493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.887777 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.888950 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:32.889803 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.892112 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Network 94a77a43-b48f-41e8-ab85-fcd5736ca725 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:32.919106 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.922416 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:32.998955 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 94a77a43-b48f-41e8-ab85-fcd5736ca725) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:33.004518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:33.006410 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.009897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7148f504-360b-449c-8578-bcb2db7d57ab None None] Network 94a77a43-b48f-41e8-ab85-fcd5736ca725 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:33.040549 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.6642544 Nov 15 12:39:33.041446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] vlan segment allocate from pool success with {'vlan_id': 611, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:33.043302 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46346) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:33.049882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Request body: {'subnet': {'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1743657235-subnet', 'tenant_id': '27402858adce449996a04024b968bae3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:33.058419 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] vlan segment allocate from pool success with {'vlan_id': 642, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:33.103158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:33.106386 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.113368 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-585de250-610a-4f80-be50-30c743a6fa4c admin admin] Pushing event updated for resources: {'Network': ['ID=e836cde6-4e01-43bc-9750-09587b9bb5d0,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:33.119628 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.120021 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Added segment 42712e6e-6181-4ceb-bdda-98824d122256 of type vlan for network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 Nov 15 12:39:33.123951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.124344 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Added segment 11bba09a-fd6b-4b4e-bb1b-95f8a053dee0 of type vlan for network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 Nov 15 12:39:33.127646 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5112b0b-194c-4047-9909-f17e76ba7a29,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:33.128420 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:33.135109 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-66fcefea-cd46-4628-bdf8-60cb755bf16e admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.5299442 Nov 15 12:39:33.238832 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6aa9c7e7-6fa9-49a7-8ec0-40673eb69dec None None] Network 94a77a43-b48f-41e8-ab85-fcd5736ca725 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:33.253107 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d568b54-8b67-4b41-939c-80772461a0cc,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:33.259726 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.266846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.377905 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e7c6aa5-68e1-43a1-995f-61350d442702 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.379953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.382372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.383604 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:33.384930 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.394140 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.397136 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:33.398042 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.507886 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=65d6a75d-c74e-4d29-a0f1-5b5b6db06715,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:33.513135 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.9342999 Nov 15 12:39:33.538858 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46366) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:33.559225 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Request body: {'subnet': {'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-subnet', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:33.604349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Checking segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:33.604761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Network hostable DHCP agents. Network: e836cde6-4e01-43bc-9750-09587b9bb5d0, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:33.609402 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 2.1391804 Nov 15 12:39:33.611314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.613274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46374) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:33.624876 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Request body: {'subnet': {'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-351123365-subnet', 'tenant_id': '9273dacda2824318a7e6d2acf9f295ba', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:33.630768 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd18459e-4a48-47f1-b410-1d5168e4a79c admin admin] Pushing event updated for resources: {'Network': ['ID=3102b790-5ced-465f-afa4-ed5c98c0e5d0,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:33.646798 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:33.651361 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Made reservation on behalf of 5e23e880e5674cdb85e83c616f14f549 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:33.664165 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Publish callbacks [] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.667502 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:33.731018 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, e836cde6-4e01-43bc-9750-09587b9bb5d0) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:33.755960 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:33.757674 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:33.806964 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a55a242e-20da-46fc-9297-7617614ad6ef None None] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:33.871320 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-813117cf-2e47-4eb9-bd03-6b20329033e8 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.8244495 Nov 15 12:39:33.947192 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Made reservation on behalf of 9273dacda2824318a7e6d2acf9f295ba for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:33.949544 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Publish callbacks [] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.013480 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.130972 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac24af71-ce9d-47b2-a800-8b7fc2391e39,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:34.155047 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Pushing event updated for resources: {'Subnet': ['ID=45ee91be-922e-4559-8cc0-d7bba19c0c19,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:34.175360 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24e89c02-2baf-4f4f-9c51-56dafce3c749 None None] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:34.183877 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9a69aa-60cd-469f-b859-eb55e31b1293 admin admin] Pushing event updated for resources: {'Network': ['ID=7e6e34e4-b05e-4c98-9266-31ca11e16a97,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:34.225435 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:34.260791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Checking segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:34.262231 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Checking segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:34.263283 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Network hostable DHCP agents. Network: 7e6e34e4-b05e-4c98-9266-31ca11e16a97, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:34.266958 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Network hostable DHCP agents. Network: 4a1ca915-de15-4ccc-96e8-10f04d0723e3, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:34.307738 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:34.335454 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 7e6e34e4-b05e-4c98-9266-31ca11e16a97) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:34.341163 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:34.342124 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.358303 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:34.371318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6792de5f-2903-4084-948a-61299598e1b0 None None] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:34.371819 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 4a1ca915-de15-4ccc-96e8-10f04d0723e3) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:34.379812 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-aa2021da-5f02-4ad0-b494-a9f7e2386f6d admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.8302495 Nov 15 12:39:34.379931 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46430) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:34.389343 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:34.390964 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:34.392199 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.413805 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d03936c-8621-4220-ae2e-31cf34ea46a0 None None] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:34.459915 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.461209 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.466736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46440) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:34.493434 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1370337987-network', 'tenant_id': '16013a2d72cd4de785908155d07697e1'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:34.516591 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f09c2934-74e3-4116-8ecf-c0fe3fa67b59 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 2.0415041 Nov 15 12:39:34.522941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46444) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:34.540559 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:34.750580 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Made reservation on behalf of 16013a2d72cd4de785908155d07697e1 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:34.761954 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.770812 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.778882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.791188 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.928787 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Pushing event updated for resources: {'Subnet': ['ID=d52c5911-a606-4287-aa04-2d2021b05259,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:34.949442 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:34.951081 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.094317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46498) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:35.136726 dv-cinder-803823-7-iscsi neutron-server[108286]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 15 12:39:35.137514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46428fac-c3f2-4878-a71a-6d2ef571846b None None] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:35.192158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.312896 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Checking segment: {'id': '42712e6e-6181-4ceb-bdda-98824d122256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:35.313414 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Network hostable DHCP agents. Network: 3102b790-5ced-465f-afa4-ed5c98c0e5d0, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:35.358260 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.366761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.385710 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.386037 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] vlan segment allocate from pool success with {'vlan_id': 622, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:39:35.425857 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.426198 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Added segment 0ae4c184-d318-4c13-8c9f-10629678af94 of type vlan for network b11a9f68-a03a-4947-b126-bc796c02d34c Nov 15 12:39:35.441450 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e3d8b5e-cd4d-4be0-bf96-8694dee790fd,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:35.458846 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:39:35.460987 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.548759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.611669 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.612649 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:35.613583 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.633563 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Allocated IP 172.20.0.2 (7e6e34e4-b05e-4c98-9266-31ca11e16a97/45ee91be-922e-4559-8cc0-d7bba19c0c19/66dc9037-19b5-4258-b494-e14e8ce2303d) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:35.635301 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.715436 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:35.730846 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.2605302 Nov 15 12:39:35.732371 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.736055 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46518) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:35.745944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Request body: {'subnet': {'network_id': 'b11a9f68-a03a-4947-b126-bc796c02d34c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1370337987-subnet', 'tenant_id': '16013a2d72cd4de785908155d07697e1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:35.754971 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a65126b1-f0a5-4958-a800-c0cd6d8d4cf1 admin admin] Pushing event updated for resources: {'Network': ['ID=b11a9f68-a03a-4947-b126-bc796c02d34c,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:35.779888 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 3102b790-5ced-465f-afa4-ed5c98c0e5d0) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:35.826622 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network b11a9f68-a03a-4947-b126-bc796c02d34c details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:39:35.828692 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15ec1feb-b552-4a48-aac9-6f36b9a7fa0f None None] Network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:35.879946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:35.884344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.887532 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Allocated IP 172.27.0.65 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/af310350-e94a-4200-b190-cf66fbee7948) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:35.934520 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.947379 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Made reservation on behalf of 16013a2d72cd4de785908155d07697e1 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:35.950259 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Publish callbacks [] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.955679 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2f643e9a-c46f-400a-aea1-b24b54c846b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:35.963826 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f7c9a898-ac71-4a79-90cf-39c6474b67bf admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.3468800 Nov 15 12:39:35.987661 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.025151 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.027372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-c9097d60-3bfa-4e6c-8a6b-6dae8052deb2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:36.031880 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-c9097d60-3bfa-4e6c-8a6b-6dae8052deb2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.9147229 Nov 15 12:39:36.074508 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.100542 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:36.123632 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:36.133240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.164229 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:36.175488 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Pushing event updated for resources: {'Port': ['ID=66dc9037-19b5-4258-b494-e14e8ce2303d,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:36.186248 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.186936 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.187081 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.187359 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.188492 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.188880 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.189354 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.189696 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.190034 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.190364 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.190678 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.191224 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Tracked resource versions report: Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: pushed versions: Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: { 'AddressGroup': {'1.2'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'ConntrackHelper': {'1.0'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Log': {'1.0'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Network': {'1.1'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Port': {'1.7'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'PortForwarding': {'1.2'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'QosPolicy': {'1.10'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroup': {'1.5'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SubPort': {'1.0'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Subnet': {'1.1'}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Trunk': {'1.1'}} Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: consumer versions: Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: HyperV agent@hv-cinder-80382: {}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'ConntrackHelper': '1.0', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Log': '1.0', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Network': '1.1', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Port': '1.7', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'PortForwarding': '1.2', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'QosPolicy': '1.10', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroup': '1.5', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SecurityGroupRule': '1.2', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'SubPort': '1.0', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Subnet': '1.1', Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: 'Trunk': '1.1'}} Nov 15 12:39:36.192076 dv-cinder-803823-7-iscsi neutron-server[108288]: {{(pid=108288) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:39:36.213452 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42728cd-cf36-4541-a9e8-e8ff15583ff6 None None] Network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:36.237716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:36.245732 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:36.247566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Pushing event updated for resources: {'Port': ['ID=af310350-e94a-4200-b190-cf66fbee7948,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:36.271079 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:36.330341 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46542) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:36.337765 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-fd8e4ab0-a2d2-435a-968a-c01833804c15 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/quotas/27402858adce449996a04024b968bae3 HTTP/1.1" status: 200 len: 375 time: 0.2282941 Nov 15 12:39:36.353900 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Attempting to bind port 66dc9037-19b5-4258-b494-e14e8ce2303d on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:36.354274 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Attempting to bind port 66dc9037-19b5-4258-b494-e14e8ce2303d by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:36.354649 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Attempting to bind port 66dc9037-19b5-4258-b494-e14e8ce2303d on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:36.364187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:36.365125 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Checking segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:36.365523 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.365905 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Bound using segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:36.366497 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Bound port: 66dc9037-19b5-4258-b494-e14e8ce2303d, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:36.366874 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.480833 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-52cee7ab-a8d8-422e-b8ef-f3ec260b9c19 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1368768 Nov 15 12:39:36.554727 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] For port 66dc9037-19b5-4258-b494-e14e8ce2303d, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:36.560419 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] For port 66dc9037-19b5-4258-b494-e14e8ce2303d, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=66dc9037-19b5-4258-b494-e14e8ce2303d,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:36.570622 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.634560 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a7c9a9-a343-44a5-bd0c-7c15b8fc3f01 None None] Pushing event updated for resources: {'Port': ['ID=66dc9037-19b5-4258-b494-e14e8ce2303d,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:36.740301 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.784723 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.830143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-259d5b0a-6374-4a17-8468-989ecb9cf326 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.838838 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:36.839768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46574) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:36.842167 dv-cinder-803823-7-iscsi neutron-server[108287]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 15 12:39:36.861781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-58942d53-e7dc-4f0a-98da-45a8306d1798 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:39:36.862797 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-58942d53-e7dc-4f0a-98da-45a8306d1798 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1458199 Nov 15 12:39:36.961431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.058639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Pushing event updated for resources: {'Subnet': ['ID=8cf5770a-1b6f-4d02-af1b-f016f1e0b85b,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:37.058639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.058639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Checking segment: {'id': '0ae4c184-d318-4c13-8c9f-10629678af94', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'b11a9f68-a03a-4947-b126-bc796c02d34c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:37.058639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Network hostable DHCP agents. Network: b11a9f68-a03a-4947-b126-bc796c02d34c, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:39:37.165571 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-14c70aa2-9cac-43ea-9c1e-5a6b84be1112 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2883804 Nov 15 12:39:37.170663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Network b11a9f68-a03a-4947-b126-bc796c02d34c is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:39:37.180730 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-7a2220ec-8a0b-4e23-9796-7eb3501f934c tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:37.182302 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-7a2220ec-8a0b-4e23-9796-7eb3501f934c tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/networks?id=3102b790-5ced-465f-afa4-ed5c98c0e5d0 HTTP/1.1" status: 200 len: 811 time: 0.3413937 Nov 15 12:39:37.218505 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-259d5b0a-6374-4a17-8468-989ecb9cf326 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.226561 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-91f9b3c5-fa30-4452-a953-18f790d4c009 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/quotas/9273dacda2824318a7e6d2acf9f295ba HTTP/1.1" status: 200 len: 375 time: 0.0326979 Nov 15 12:39:37.228057 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, b11a9f68-a03a-4947-b126-bc796c02d34c) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:37.233417 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-259d5b0a-6374-4a17-8468-989ecb9cf326 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.244678 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4e1cdc7-16a9-48ac-8566-dc4e2fd01178 None None] Network b11a9f68-a03a-4947-b126-bc796c02d34c requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:37.267028 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:37.267687 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.297632 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 66dc9037-19b5-4258-b494-e14e8ce2303d up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:37.301393 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Allocated IP 172.27.0.53 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/d4ffc72f-ff7a-4b37-b3f5-431b95c220b2) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:37.308242 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.316529 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-cf5f6afa-8a0b-40d8-9a7b-e879df5095db admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.5713749 Nov 15 12:39:37.341557 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259d5b0a-6374-4a17-8468-989ecb9cf326 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdd74410-f6b6-48de-aeac-b263ffbb6d7c,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:37.366601 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-259d5b0a-6374-4a17-8468-989ecb9cf326 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=ec9b6b86ec184a5ba674a8b8d9bf1792&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0330555 Nov 15 12:39:37.378831 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46580) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:37.416825 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-f37a1e91-e82f-43c0-8e37-f4f1133d5856 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2180812 Nov 15 12:39:37.502976 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46582) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:37.523473 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.524411 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 66dc9037-19b5-4258-b494-e14e8ce2303d triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:37.524962 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.561360 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.573271 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-166bded6-38b3-4fec-9903-ca8223fc4695 None None] Network b11a9f68-a03a-4947-b126-bc796c02d34c requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:37.619514 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.645470 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Deleting subnet 7fada893-d8c0-485f-b929-6d777a0d0bb7 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:39:37.682110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.708089 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-e1551ca8-4321-4189-b832-26d73067194a tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=9273dacda2824318a7e6d2acf9f295ba&fields=id HTTP/1.1" status: 200 len: 210 time: 0.4612629 Nov 15 12:39:37.840052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Router 4512181d-cbaf-4499-9428-f436a2106d4f is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:39:37.863430 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.898696 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.902634 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:37.949149 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.006253 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 66dc9037-19b5-4258-b494-e14e8ce2303d, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=66dc9037-19b5-4258-b494-e14e8ce2303d,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:39:38.011868 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.073369 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-315b8551-e712-402b-a8de-6e307ee7cb2c service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:39:38.075994 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=66dc9037-19b5-4258-b494-e14e8ce2303d,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:38.082438 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-315b8551-e712-402b-a8de-6e307ee7cb2c service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2807097 Nov 15 12:39:38.091349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:39:38.104646 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:39:38.125124 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:38.126317 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:38.205358 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-49591be0-6b02-4a6d-a5b7-3baf62d9abca service neutron] 10.222.0.44 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1219637 Nov 15 12:39:38.217149 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.218281 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bd6862e1-326d-4ebf-8b60-6b7ea7b61ac1 admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 3.8370128 Nov 15 12:39:38.225197 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46614) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:38.229399 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-364b3ddb-1606-4c17-8d56-9157f3c73a69 None None] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:39:38.272642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Pushing event updated for resources: {'Port': ['ID=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:38.279745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.282360 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.283793 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/bdd74410-f6b6-48de-aeac-b263ffbb6d7c HTTP/1.1" status: 204 len: 168 time: 0.9040003 Nov 15 12:39:38.421605 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:38.436394 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3aed6c4b-eae6-40d5-a857-9979e045e005 req-19a1d968-5337-4922-94e8-eea6f0c708b1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.1665213 Nov 15 12:39:38.448521 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea9de61-903b-464a-b29c-aad7e656dde9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdd74410-f6b6-48de-aeac-b263ffbb6d7c,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:38.462436 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:38.511198 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-79341d49-0366-4bd2-8591-85acc8aed6ca service neutron] 10.222.0.44 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3047783 Nov 15 12:39:38.516614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:38.558577 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:38.704625 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-57c637de-fd26-41c0-8950-1015ab8c733e None None] Provisioning complete for port 66dc9037-19b5-4258-b494-e14e8ce2303d triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:38.706093 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-57c637de-fd26-41c0-8950-1015ab8c733e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.757477 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:38.992912 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46638) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:39.013080 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.013888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5a9ac147-533e-4f34-879c-0d685c773800 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.031421 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.110891 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:36Z', 'revision_number': 3, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:39.125176 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7fada893-d8c0-485f-b929-6d777a0d0bb7,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:39.165602 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.203564 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:39:39.204599 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Updating router 4512181d-cbaf-4499-9428-f436a2106d4f port af310350-e94a-4200-b190-cf66fbee7948 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:39:39.252302 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 66dc9037-19b5-4258-b494-e14e8ce2303d up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:39.273619 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.336326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5a9ac147-533e-4f34-879c-0d685c773800 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.350930 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5a9ac147-533e-4f34-879c-0d685c773800 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.371482 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.387344 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-30cff6ab-997c-4bf3-96bb-fb213aac84e5 None None] Provisioning complete for port 66dc9037-19b5-4258-b494-e14e8ce2303d triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:39.387709 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5a9ac147-533e-4f34-879c-0d685c773800 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b98173f0e502494e9a4dac2f061400b1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3933933 Nov 15 12:39:39.392161 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46658) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:39.392495 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-97217103-2a8c-40b7-966c-a105976a4bcc admin admin] 10.222.0.44 "DELETE /v2.0/subnets/7fada893-d8c0-485f-b929-6d777a0d0bb7 HTTP/1.1" status: 204 len: 168 time: 1.8878117 Nov 15 12:39:39.396333 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46660) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:39.397246 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-30cff6ab-997c-4bf3-96bb-fb213aac84e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.410797 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.454556 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-227c1900-2501-432b-aa30-1e2ebfa0a3f9 req-53c3528d-44d2-4333-8894-4f28f55a0f47 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.1741488 Nov 15 12:39:39.509342 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 66dc9037-19b5-4258-b494-e14e8ce2303d triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:39.509731 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.586855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.705843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9ac147-533e-4f34-879c-0d685c773800 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cf41c37-ee0d-4773-9308-dd3421963f7f,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:39.759477 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:39:39.816718 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.830644 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.863249 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Attempting to bind port af310350-e94a-4200-b190-cf66fbee7948 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:39.863621 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Attempting to bind port af310350-e94a-4200-b190-cf66fbee7948 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:39.863991 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Attempting to bind port af310350-e94a-4200-b190-cf66fbee7948 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:39.876789 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.891382 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:39.891784 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:39.892332 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.892732 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:39.893217 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Bound port: af310350-e94a-4200-b190-cf66fbee7948, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:39.893621 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:39.919863 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f82626-5222-47a7-976d-0c899444ecc3 req-d191ec51-494d-4291-a267-e7c94367ec21 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.1291740 Nov 15 12:39:39.957090 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Pushing event updated for resources: {'Port': ['ID=af310350-e94a-4200-b190-cf66fbee7948,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:39.975006 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.975442 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.975697 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.976021 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.976380 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.976713 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.977038 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.977363 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.977714 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.978042 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.978325 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.978635 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Tracked resource versions report: Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: pushed versions: Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: { 'AddressGroup': {'1.2'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'ConntrackHelper': {'1.0'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Log': {'1.0'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Network': {'1.1'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Port': {'1.7'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'PortForwarding': {'1.2'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'QosPolicy': {'1.10'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroup': {'1.5'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroupRule': {'1.2'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SubPort': {'1.0'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Subnet': {'1.1'}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Trunk': {'1.1'}} Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: consumer versions: Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: { DHCP agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: HyperV agent@hv-cinder-80382: {}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: L3 agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: Metadata agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: Metering agent@dv-cinder-803823-7-iscsi: {}, Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: Open vSwitch agent@dv-cinder-803823-7-iscsi: { 'AddressGroup': '1.2', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'ConntrackHelper': '1.0', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Log': '1.0', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Network': '1.1', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Port': '1.7', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'PortForwarding': '1.2', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'QosPolicy': '1.10', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroup': '1.5', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SecurityGroupRule': '1.2', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'SubPort': '1.0', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Subnet': '1.1', Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: 'Trunk': '1.1'}} Nov 15 12:39:39.979750 dv-cinder-803823-7-iscsi neutron-server[108289]: {{(pid=108289) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 15 12:39:40.010085 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] For port af310350-e94a-4200-b190-cf66fbee7948, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:40.015451 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] For port af310350-e94a-4200-b190-cf66fbee7948, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=af310350-e94a-4200-b190-cf66fbee7948,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:40.016963 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.025923 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.056695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Allocated IP 172.20.0.1 (7e6e34e4-b05e-4c98-9266-31ca11e16a97/45ee91be-922e-4559-8cc0-d7bba19c0c19/4938c78e-9bc9-4df5-bf18-84ed271c479f) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:40.058774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.090736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.108571 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6de6f5-422b-4216-98d7-0cc6a6b8264e None None] Pushing event updated for resources: {'Port': ['ID=af310350-e94a-4200-b190-cf66fbee7948,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:40.123230 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.125981 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.133503 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.133882 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > port after_create 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.134277 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > port after_delete 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.134609 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > port after_update 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.135092 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.136783 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.136984 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.137337 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.175614 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:40.178515 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:40.259105 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.264588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.273544 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/1cf41c37-ee0d-4773-9308-dd3421963f7f HTTP/1.1" status: 204 len: 168 time: 0.8793337 Nov 15 12:39:40.296915 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dcc8c9a-03d9-4ba2-b3f7-a3e7fc8e9f78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cf41c37-ee0d-4773-9308-dd3421963f7f,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:40.337205 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.487994 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.514040 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:40.530898 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:40.538131 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:40.595123 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:40.595744 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.622177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.622552 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.622886 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.623230 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108286) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:40.623587 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['94a77a43-b48f-41e8-ab85-fcd5736ca725']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:40.652624 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4dbcd66-07b0-40f5-b9ad-d07882cd268d') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:40.652938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4dbcd66-07b0-40f5-b9ad-d07882cd268d') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:40.679939 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.726548 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.762211 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Releasing vlan 627 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:39:40.762613 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:40.907070 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Pushing event updated for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: from cryptography.utils import int_from_bytes Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: from cryptography.utils import int_from_bytes Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:39:40.962988 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:39:41.150233 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.158794 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-8f5f5f78-eea5-4c93-ac2b-b5dd837d692f None None] Provisioning complete for port 4938c78e-9bc9-4df5-bf18-84ed271c479f triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:41.159451 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8f5f5f78-eea5-4c93-ac2b-b5dd837d692f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.244069 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a30303d0-3e4a-44b7-a00a-711d1d11d442 req-1c3ec073-4a58-4d4f-9f61-ff6fb972f008 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.2991917 Nov 15 12:39:41.245758 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.300831 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.307756 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3f69eeae-a517-4aa5-84d0-da3fcf54f5a1 req-d287ec69-2637-42c8-b1c5-07acfa8d6a33 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0597091 Nov 15 12:39:41.313240 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] 10.222.0.44 "DELETE /v2.0/networks/94a77a43-b48f-41e8-ab85-fcd5736ca725 HTTP/1.1" status: 204 len: 168 time: 1.8914998 Nov 15 12:39:41.315360 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae154526-4caa-402a-8483-a2d75786353d admin admin] Pushing event deleted for resources: {'Network': ['ID=94a77a43-b48f-41e8-ab85-fcd5736ca725,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:41.318133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46720) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:41.320679 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Router 58cc1308-fc78-4246-a2a3-a75fe0220067 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108286) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:39:41.330740 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:36Z', 'revision_number': 3, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:41.349235 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-8f5f5f78-eea5-4c93-ac2b-b5dd837d692f None None] Port 4938c78e-9bc9-4df5-bf18-84ed271c479f cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:39:41.417313 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a9bdcd8-f09a-4737-80b3-333f8ba56b99 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:36Z', 'revision_number': 3, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:39:41.450074 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Deleting subnet 8cf5770a-1b6f-4d02-af1b-f016f1e0b85b {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:39:41.460424 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.534984 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.715395 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.728584 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:39:41.748455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Sync routers for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:39:41.782744 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.784334 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:41.786126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:41.792004 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.798572 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-49698219-669c-40f5-85c6-a6f406d084d5 admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 7.2718737 Nov 15 12:39:41.799767 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46730) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:41.841002 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:41.841713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.015905 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.61', 61947) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:42.053557 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Pushing event updated for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:42.088872 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.138336 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.171257 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:42.183989 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8cf5770a-1b6f-4d02-af1b-f016f1e0b85b,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:42.273115 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.292790 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-7d99bff8-0825-48cf-9589-635062279657 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/8cf5770a-1b6f-4d02-af1b-f016f1e0b85b HTTP/1.1" status: 204 len: 168 time: 0.9732800 Nov 15 12:39:42.309086 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46744) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:42.537580 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:38Z', 'revision_number': 3, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:42.597489 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Checking router: 58cc1308-fc78-4246-a2a3-a75fe0220067 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:39:42.599882 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Updating router 58cc1308-fc78-4246-a2a3-a75fe0220067 port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:39:42.662262 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.739572 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.61', 61952) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:42.810818 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f32e6e20-1717-45b9-97c6-87554fb2defc req-b05b7a59-ca8a-4c05-bdb8-4b7415f79cd8 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.1236641 Nov 15 12:39:42.864404 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:42.901987 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:42.907851 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:42.975994 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-88a9c5a9-437c-41f4-989e-36345ceffa1b req-f88a26c6-64f6-4195-96fb-7137fb850568 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.4077914 Nov 15 12:39:43.056141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46772) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:43.349535 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device af310350-e94a-4200-b190-cf66fbee7948 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:43.516055 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-0ebcc35c-4ad3-460b-b97b-800c9d7c0b57 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:43.518484 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-0ebcc35c-4ad3-460b-b97b-800c9d7c0b57 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 1.4979396 Nov 15 12:39:43.553592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:43.641439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-c8454c5c-1739-4077-9d90-fcb140d3124e tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:43.643931 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-c8454c5c-1739-4077-9d90-fcb140d3124e tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.61 "GET /v2.0/networks?id=3102b790-5ced-465f-afa4-ed5c98c0e5d0 HTTP/1.1" status: 200 len: 811 time: 0.8772471 Nov 15 12:39:43.655365 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-35fcd6b0-2a2b-43c9-8504-0990413952e3 None None] Provisioning complete for port 4938c78e-9bc9-4df5-bf18-84ed271c479f triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:43.655730 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-35fcd6b0-2a2b-43c9-8504-0990413952e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:43.675231 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Request body: {'port': {'device_id': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'admin_state_up': True, 'tenant_id': '27402858adce449996a04024b968bae3'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:43.705864 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:39:43.710530 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port af310350-e94a-4200-b190-cf66fbee7948 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:43.710899 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:43.729542 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.730980 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.732444 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.733207 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > port after_create 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.733999 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.734759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > port after_update 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.735528 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.736782 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.737402 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Request body: {'port': {'device_id': '5a60575a-1a5f-4803-a19e-47821edba597', 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0', 'admin_state_up': True, 'tenant_id': '9273dacda2824318a7e6d2acf9f295ba'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:43.738056 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.738800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:43.754405 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-35fcd6b0-2a2b-43c9-8504-0990413952e3 None None] Port 4938c78e-9bc9-4df5-bf18-84ed271c479f cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:39:43.874247 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:43.898730 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port af310350-e94a-4200-b190-cf66fbee7948, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=af310350-e94a-4200-b190-cf66fbee7948,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:39:43.906360 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:43.990508 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.012615 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.057061 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=af310350-e94a-4200-b190-cf66fbee7948,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:44.185752 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Attempting to bind port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:44.186502 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Attempting to bind port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:44.186884 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Attempting to bind port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:44.204924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:44.214789 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:44.215596 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.216385 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:44.217334 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Bound port: d4ffc72f-ff7a-4b37-b3f5-431b95c220b2, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:44.236452 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.311259 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64166f1-43d6-41f4-978b-e866341030ab None None] Pushing event updated for resources: {'Port': ['ID=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:44.413503 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] For port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:44.417312 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] For port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:44.427911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.450588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:44.451199 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:44.451440 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:44.451576 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 15 12:39:44.451946 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b11a9f68-a03a-4947-b126-bc796c02d34c']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:44.530635 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5a6643e3-9d2d-4b21-9ebf-f10ff1522b91 req-dfd67339-9caf-493f-9074-eac41522608b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.2704940 Nov 15 12:39:44.542428 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:44.543485 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:44.548910 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64166f1-43d6-41f4-978b-e866341030ab None None] Pushing event updated for resources: {'Port': ['ID=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:44.592246 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0ae4c184-d318-4c13-8c9f-10629678af94') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:44.592731 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0ae4c184-d318-4c13-8c9f-10629678af94') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:44.686323 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-380cd939-1404-426f-abbd-c407811529ed req-d5fafee9-393b-43ff-8558-6dea39f8a443 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.1472957 Nov 15 12:39:44.698233 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9c90d1e4-dbfd-4169-9636-68cfd4e32b32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.725388 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:44.822713 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:44.984910 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.027128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Releasing vlan 622 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:39:45.032357 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: from cryptography.utils import int_from_bytes Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: from cryptography.utils import int_from_bytes Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:39:45.050999 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:39:45.081606 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Made reservation on behalf of 9273dacda2824318a7e6d2acf9f295ba for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:45.088721 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.151489 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:39:45.159470 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-46cc3607-b893-4f8b-8d6f-bb60f8ae5496 admin admin] 10.222.0.44 "PUT /v2.0/routers/4512181d-cbaf-4499-9428-f436a2106d4f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9213130 Nov 15 12:39:45.174150 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:39:45.190155 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:45.193442 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:45.230791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.244226 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.266343 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device af310350-e94a-4200-b190-cf66fbee7948 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:45.311802 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.329327 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] 10.222.0.44 "DELETE /v2.0/networks/b11a9f68-a03a-4947-b126-bc796c02d34c HTTP/1.1" status: 204 len: 168 time: 3.0148513 Nov 15 12:39:45.350706 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5d83e-c2a3-4219-9da3-862bbb93dcf6 admin admin] Pushing event deleted for resources: {'Network': ['ID=b11a9f68-a03a-4947-b126-bc796c02d34c,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:45.473743 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:45.509034 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9c90d1e4-dbfd-4169-9636-68cfd4e32b32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.517545 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9c90d1e4-dbfd-4169-9636-68cfd4e32b32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.536514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:38Z', 'revision_number': 3, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:45.752511 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-625e7392-db11-4c28-b24a-600bcd3ce8e7 None None] The sync data for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi is: [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:38Z', 'revision_number': 3, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:39:45.753303 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9c90d1e4-dbfd-4169-9636-68cfd4e32b32 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=fea40dba765e4966ae0bc8d5d4cca8ea&name=default HTTP/1.1" status: 200 len: 2993 time: 2.3395057 Nov 15 12:39:45.756891 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 2, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:45.768776 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c90d1e4-dbfd-4169-9636-68cfd4e32b32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a433c7fc-ab14-4092-b4a0-b4265241b80b,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:45.784292 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46860) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:45.801799 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port af310350-e94a-4200-b190-cf66fbee7948 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:45.803477 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:39:45.808707 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:39:45.809451 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Updating router 4512181d-cbaf-4499-9428-f436a2106d4f port 4938c78e-9bc9-4df5-bf18-84ed271c479f binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:39:45.810317 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.830854 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:45.866711 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.002293 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6232db20-3f53-48e5-a6d6-d72a75d99cf0 req-ba9525b9-2110-44c8-a68e-d4aa13664f82 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.1495912 Nov 15 12:39:46.004635 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46864) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:46.113062 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8fb66b6d-88ef-46d2-be82-a3b4b2b48821 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b6483280ad224deba52ad37834829ec4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1067364 Nov 15 12:39:46.114027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46868) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:46.180662 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.346198 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-59472719-f0db-4bef-93a0-82ad6de26103 req-b587ad7d-8c5b-474a-8cc4-131d21eaf874 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.0686064 Nov 15 12:39:46.453119 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.611770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.715235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Allocated IP 172.20.0.10 (e836cde6-4e01-43bc-9750-09587b9bb5d0/65d6a75d-c74e-4d29-a0f1-5b5b6db06715/1bf5cf4f-25e6-407d-8d56-f33732c6f670) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:46.743445 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.814698 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.838924 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:46.840846 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a433c7fc-ab14-4092-b4a0-b4265241b80b HTTP/1.1" status: 204 len: 168 time: 1.0538535 Nov 15 12:39:46.957571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1605cf87-cc14-4c53-8d14-4278c43a7b89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a433c7fc-ab14-4092-b4a0-b4265241b80b,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:47.013253 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:47.016345 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:47.017735 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f6d48c5d-c1f2-424f-8ea3-f44d72263c61 HTTP/1.1" status: 204 len: 168 time: 0.9013004 Nov 15 12:39:47.102760 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7482237-164b-43bf-a459-ab40aff63d2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6d48c5d-c1f2-424f-8ea3-f44d72263c61,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:47.266456 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7481b1e0-ed61-4d7c-b21b-ebe86a33ee39 req-4504ec3e-83b0-4fad-8bc6-6fecaf634e0d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0895300 Nov 15 12:39:47.464058 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:47.485073 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:47.496072 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:47.639672 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e62168c1-df89-4d8b-8ea1-c2f00966934b req-664f842a-b4bb-452c-8ead-bcfce1150b45 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.0994880 Nov 15 12:39:47.847483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:47.850216 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:47.955320 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ba6479-845d-41ac-b186-10ab3a7cec50 None None] Pushing event updated for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:47.973279 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Attempting to bind port 4938c78e-9bc9-4df5-bf18-84ed271c479f on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:47.973766 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Attempting to bind port 4938c78e-9bc9-4df5-bf18-84ed271c479f by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:47.974074 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Attempting to bind port 4938c78e-9bc9-4df5-bf18-84ed271c479f on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:47.999244 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Allocated IP 172.20.0.12 (3102b790-5ced-465f-afa4-ed5c98c0e5d0/d52c5911-a606-4287-aa04-2d2021b05259/cf81a6f4-3d88-4d0e-b9d2-b79c61aea820) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:48.016078 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:48.023422 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Checking segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:48.023864 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.024298 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Bound using segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:48.029167 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Bound port: 4938c78e-9bc9-4df5-bf18-84ed271c479f, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:48.029588 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.179723 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46910) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:48.184725 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group': {'name': 'tempest-securitygroup--688600663', 'description': 'tempest-description--528985025'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:48.223545 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Allocated IP 172.20.0.1 (4a1ca915-de15-4ccc-96e8-10f04d0723e3/ac24af71-ce9d-47b2-a800-8b7fc2391e39/1704d939-fa50-440a-83ed-bcfa8264fa57) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:48.254002 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.300072 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] For port 4938c78e-9bc9-4df5-bf18-84ed271c479f, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:48.322100 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] For port 4938c78e-9bc9-4df5-bf18-84ed271c479f, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=4938c78e-9bc9-4df5-bf18-84ed271c479f,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:48.335682 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.356754 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.358126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] Provisioning complete for port 4938c78e-9bc9-4df5-bf18-84ed271c479f triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:48.358494 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.480488 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.572826 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:39:48.620692 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.651952 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ba6479-845d-41ac-b186-10ab3a7cec50 None None] Pushing event updated for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=4']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:48.704703 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3bc76c23-de9d-40be-9010-38ec4c1003ab req-bc2ca53a-f86f-4911-87dd-820e0d952b45 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.1167982 Nov 15 12:39:48.764776 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.777010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:48.788054 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:48.788054 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:48.868175 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46928) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:48.995906 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:49.069710 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.100002 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.104249 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.9209452 Nov 15 12:39:49.126659 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46938) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:49.192202 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19daf7a-66a5-4f2d-aee5-aaada856ce21 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroup': ['ID=da4a15c8-b16c-4a62-801f-33492179f865,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:49.222157 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group_rule': {'security_group_id': 'da4a15c8-b16c-4a62-801f-33492179f865', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:49.315118 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:49.438548 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5c5f808f-2912-48a3-a38c-12efe7bb0b46 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=16013a2d72cd4de785908155d07697e1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5315638 Nov 15 12:39:49.450311 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46946) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:49.548341 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.642848 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.685090 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.831690 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.846822 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:49.871375 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3758d969-3285-464e-a2d1-cbc30208cebb req-9c49a013-9371-410e-b2cb-af782c8d5722 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.4346099 Nov 15 12:39:49.894445 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:49.929837 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.003782 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:50.084528 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:50.102347 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46958) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:50.118332 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:50.129488 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.133630 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98997d8a-2134-4515-b1b3-a6cef3e0f178 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:39:50.139524 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:50.140630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:50.142491 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] For port 4938c78e-9bc9-4df5-bf18-84ed271c479f, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=4938c78e-9bc9-4df5-bf18-84ed271c479f,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:39:50.167765 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.193132 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:50.206157 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:50.220751 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b68293a-a606-49ca-aa9c-5999d033ffb2,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:50.247648 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.286998 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.289259 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f2514c4f-69b8-4f9f-ad22-94f05621c708 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1373377 Nov 15 12:39:50.322538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46964) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:50.341892 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group_rule': {'security_group_id': 'da4a15c8-b16c-4a62-801f-33492179f865', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:50.372832 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.387927 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:50.387927 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.411628 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef344fa9-460a-409f-905c-1fd691f1237a req-c47dfbc8-d16e-405f-8a6f-53e142bb32a1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:50.423231 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef344fa9-460a-409f-905c-1fd691f1237a req-c47dfbc8-d16e-405f-8a6f-53e142bb32a1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 932 time: 0.5251210 Nov 15 12:39:50.478762 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-24bb1985-c46f-470f-9510-d8e12a7322e0 None None] Provisioning complete for port 4938c78e-9bc9-4df5-bf18-84ed271c479f triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:50.479537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-24bb1985-c46f-470f-9510-d8e12a7322e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.593891 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef344fa9-460a-409f-905c-1fd691f1237a req-400cbbd9-441d-4a4b-960e-de0f6075cec6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1693144 Nov 15 12:39:50.610366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.635000 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-15e622eb-6eb7-4ad5-a9a4-30c78618bca3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.666571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f999ea9-3800-45a1-9af7-2931e37e7074 None None] Pushing event updated for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:50.777940 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.974487 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:50.993355 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.011788 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.017236 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/3e3d8b5e-cd4d-4be0-bf96-8694dee790fd HTTP/1.1" status: 204 len: 168 time: 1.5599308 Nov 15 12:39:51.087773 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event updated for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:51.106503 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.224956 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f23a6b-6950-4040-b367-a648ecff104a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e3d8b5e-cd4d-4be0-bf96-8694dee790fd,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:51.225912 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:51.226582 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.265377 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-15e622eb-6eb7-4ad5-a9a4-30c78618bca3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.269690 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2e0a6d52-42d8-4575-bbbe-20482bc10299,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:51.277217 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-15e622eb-6eb7-4ad5-a9a4-30c78618bca3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.327893 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.335904 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-cdbc59b9-bfb2-4aa8-9602-e87a9005805b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0030460 Nov 15 12:39:51.350973 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 46982) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:51.379220 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e584e3c0-52c7-46c9-9cf1-494e72c8de8a req-1416e0fd-3de9-4555-bf2f-f10a833120d8 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.2653375 Nov 15 12:39:51.416319 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 4938c78e-9bc9-4df5-bf18-84ed271c479f up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:51.468561 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:51.519474 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-15e622eb-6eb7-4ad5-a9a4-30c78618bca3 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=85548be7977a4bb594877a761accb622&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4005377 Nov 15 12:39:51.522203 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-69080fdc-ce97-433e-a6c1-e8b2423684ed tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 7.8684740 Nov 15 12:39:51.542865 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 46986) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:51.609320 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 4938c78e-9bc9-4df5-bf18-84ed271c479f triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:51.612068 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.662617 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Pushing event updated for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:51.885872 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:51.990708 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.003888 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-1fb39ba5-569b-49e6-939d-1580fc7fb258 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:39:52.010358 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-1fb39ba5-569b-49e6-939d-1580fc7fb258 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0396147 Nov 15 12:39:52.021813 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.118840 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e622eb-6eb7-4ad5-a9a4-30c78618bca3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5944f290-1a22-4955-a12c-0b4abb4bbae0,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:52.121166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:52.164062 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:52.302736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035ee3a8-f873-4f79-885c-5bfe32a6e1e6 req-07edbaef-57a8-48eb-b008-1f26e5080bf5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:52.305209 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-035ee3a8-f873-4f79-885c-5bfe32a6e1e6 req-07edbaef-57a8-48eb-b008-1f26e5080bf5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 932 time: 0.1692574 Nov 15 12:39:52.377676 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.518540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.535098 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.540384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:52.555376 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-035ee3a8-f873-4f79-885c-5bfe32a6e1e6 req-7ca753ef-a6b0-4f5a-b7ba-35b7f63fb08d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2284985 Nov 15 12:39:52.564680 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.638795 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.643973 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.649688 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/5944f290-1a22-4955-a12c-0b4abb4bbae0 HTTP/1.1" status: 204 len: 168 time: 1.1021459 Nov 15 12:39:52.688924 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f605f6a-0770-479a-bd02-e33b56130234 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5944f290-1a22-4955-a12c-0b4abb4bbae0,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:52.837347 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:52.842663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:52.862651 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Pushing event updated for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:53.404324 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:53.434014 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-8397f31c-4ceb-4273-8e57-b961e0982fd3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 9.7475677 Nov 15 12:39:53.448043 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Request body: {'port': {'device_id': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:53.571051 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Pushing event updated for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:53.717161 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47046) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:53.759991 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a1ee9bf8-0d99-442f-a630-4751324d0f0f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:53.806121 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84ba53f-f05e-435f-8feb-7aefb80f25bb req-47aee0d0-06af-489d-a035-3d9ad0a76e12 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:53.814450 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a84ba53f-f05e-435f-8feb-7aefb80f25bb req-47aee0d0-06af-489d-a035-3d9ad0a76e12 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 932 time: 0.1097534 Nov 15 12:39:53.965310 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:53.972881 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:53.984810 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a84ba53f-f05e-435f-8feb-7aefb80f25bb req-36b9b683-dc6d-4e3b-ba21-9e67ed405591 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1363912 Nov 15 12:39:54.039234 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a1ee9bf8-0d99-442f-a630-4751324d0f0f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.053711 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a1ee9bf8-0d99-442f-a630-4751324d0f0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.065177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466a8741-9e5e-48fd-b21e-cae157bf6e6a req-f892ba5c-e3f8-41ba-aed5-74a7f1e94982 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:54.080857 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-466a8741-9e5e-48fd-b21e-cae157bf6e6a req-f892ba5c-e3f8-41ba-aed5-74a7f1e94982 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 932 time: 1.2777603 Nov 15 12:39:54.110087 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a1ee9bf8-0d99-442f-a630-4751324d0f0f admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=017a263d48f64d269d26af0e2830f47d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3898764 Nov 15 12:39:54.113392 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47068) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:54.122123 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ee9bf8-0d99-442f-a630-4751324d0f0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f296bc15-be7d-4b27-ae30-483d9fc99c60,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:54.262021 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.273198 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.309757 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.372970 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.376096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.378719 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f296bc15-be7d-4b27-ae30-483d9fc99c60 HTTP/1.1" status: 204 len: 168 time: 0.2441945 Nov 15 12:39:54.397668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a798f3f-7533-4f38-ac34-8e7848ad1adb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f296bc15-be7d-4b27-ae30-483d9fc99c60,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:54.478235 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-466a8741-9e5e-48fd-b21e-cae157bf6e6a req-3fc15c3c-246f-42e7-8262-8edf879ee736 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3952644 Nov 15 12:39:54.595081 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Router 58cc1308-fc78-4246-a2a3-a75fe0220067 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:39:54.641849 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:54.977566 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Allocated IP 172.27.0.101 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/ecf51f4c-5ca7-49e7-96f3-5839637ce8f8) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:39:54.983103 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47088) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:54.983806 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:39:55.008332 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Sync routers for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:39:55.024071 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8c65dab0-1bdb-4628-92b4-9cba5a789aa4 admin admin] 10.222.0.44 "PUT /v2.0/routers/58cc1308-fc78-4246-a2a3-a75fe0220067/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.2227421 Nov 15 12:39:55.042069 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:55.044890 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:55.275458 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0b378a-21d6-4aed-8e12-678d8f21af52 req-46ba2ce0-31cd-4a97-8281-9debd04adc37 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:55.301416 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb0b378a-21d6-4aed-8e12-678d8f21af52 req-46ba2ce0-31cd-4a97-8281-9debd04adc37 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 932 time: 0.1605372 Nov 15 12:39:55.448706 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb0b378a-21d6-4aed-8e12-678d8f21af52 req-5a6ec04c-7499-438b-95cf-6a792d951b4a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1462729 Nov 15 12:39:55.467751 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:55.489924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.503464 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0104ee7-f1cc-4644-b6a7-6af3a18e2570 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.538659 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.569340 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:39:55.573344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:39:55.645680 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:39:55.713912 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0104ee7-f1cc-4644-b6a7-6af3a18e2570 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.735366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0104ee7-f1cc-4644-b6a7-6af3a18e2570 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.796736 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d0104ee7-f1cc-4644-b6a7-6af3a18e2570 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=78f629387efc424bbb834c014973c173&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8088138 Nov 15 12:39:55.797688 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0104ee7-f1cc-4644-b6a7-6af3a18e2570 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=562c71e0-8e0e-49e2-9624-ff1e4efcea42,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:55.801025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47122) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:55.849317 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:51Z', 'revision_number': 4, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '1704d939-fa50-440a-83ed-bcfa8264fa57', 'name': '', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'mac_address': 'fa:16:3e:92:0f:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:45Z', 'updated_at': '2021-11-15T12:39:52Z', 'revision_number': 2, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'subnets': [{'id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:55.855816 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=ecf51f4c-5ca7-49e7-96f3-5839637ce8f8,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:55.864024 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.904341 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:55.909067 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Checking router: 58cc1308-fc78-4246-a2a3-a75fe0220067 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:39:55.910332 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Updating router 58cc1308-fc78-4246-a2a3-a75fe0220067 port 1704d939-fa50-440a-83ed-bcfa8264fa57 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:39:55.967823 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa1eda6-edab-4c26-ab0d-374673a82b08 req-62d848a5-0adc-49de-bb93-4fed1bb1bcf9 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:55.976496 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7fa1eda6-edab-4c26-ab0d-374673a82b08 req-62d848a5-0adc-49de-bb93-4fed1bb1bcf9 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 932 time: 0.3207090 Nov 15 12:39:55.992099 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.026134 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.042255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.049220 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/562c71e0-8e0e-49e2-9624-ff1e4efcea42 HTTP/1.1" status: 204 len: 168 time: 0.2439842 Nov 15 12:39:56.071252 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e1af5c-7719-499c-94b7-d75144323ca8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=562c71e0-8e0e-49e2-9624-ff1e4efcea42,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:56.091892 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1bf5cf4f-25e6-407d-8d56-f33732c6f670 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:39:56.106650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.190069 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Transition to ACTIVE for port object 1bf5cf4f-25e6-407d-8d56-f33732c6f670 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:39:56.202162 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.219958 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.268169 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Pushing event updated for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:56.281415 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7fa1eda6-edab-4c26-ab0d-374673a82b08 req-168eff90-efbe-472a-9af0-999a53b2b128 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2584064 Nov 15 12:39:56.321523 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.703018 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-d79d9182-14a2-450b-9855-cea10e35a9e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:56.716320 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-d79d9182-14a2-450b-9855-cea10e35a9e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 819 time: 0.3021145 Nov 15 12:39:56.759577 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-09e1abda-b585-4dd8-8b38-8ce6f0fdcc9d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/quotas/71e17179085148bfacb8d235fc6ee668 HTTP/1.1" status: 200 len: 375 time: 0.0408180 Nov 15 12:39:56.825861 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.838689 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:56.868281 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-7010004a-b609-408b-8bfc-92bcc7e50728 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1076038 Nov 15 12:39:57.049382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.079447 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca712cb3-9eb0-41e2-a300-d035a40c76d8 req-f2518a56-7701-4e97-b83c-1976f9e43009 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:57.084297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca712cb3-9eb0-41e2-a300-d035a40c76d8 req-f2518a56-7701-4e97-b83c-1976f9e43009 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.2640698 Nov 15 12:39:57.086421 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Attempting to bind port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:57.088653 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Attempting to bind port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:57.091344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Attempting to bind port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:57.099465 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Attempting to bind port 1704d939-fa50-440a-83ed-bcfa8264fa57 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:39:57.100094 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Attempting to bind port 1704d939-fa50-440a-83ed-bcfa8264fa57 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:39:57.100696 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Attempting to bind port 1704d939-fa50-440a-83ed-bcfa8264fa57 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:57.110994 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3462f8-3cc0-489b-bcce-3a001a8c4897 None None] Pushing event updated for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:57.112717 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.116909 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:57.117531 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Checking segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:57.118277 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.118991 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Bound using segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:57.120682 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Bound port: 1704d939-fa50-440a-83ed-bcfa8264fa57, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:57.121660 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-1f882200-7bfa-4980-8966-bdc8fcd98635 service neutron] 10.222.0.44 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2517202 Nov 15 12:39:57.122680 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.220815 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] For port 1704d939-fa50-440a-83ed-bcfa8264fa57, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:57.225748 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] For port 1704d939-fa50-440a-83ed-bcfa8264fa57, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1704d939-fa50-440a-83ed-bcfa8264fa57,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:57.239297 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.271963 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47160) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:57.298928 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-32d83296-04cb-4268-b7e0-a368821223ab admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.331197 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:39:57.331899 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:39:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:57.437925 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-673fedc0-90ac-4568-b45d-c1ee27183223 service neutron] 10.222.0.44 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3104277 Nov 15 12:39:57.544358 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3462f8-3cc0-489b-bcce-3a001a8c4897 None None] Pushing event updated for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:57.555296 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-32d83296-04cb-4268-b7e0-a368821223ab admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.576829 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-32d83296-04cb-4268-b7e0-a368821223ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.623831 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-32d83296-04cb-4268-b7e0-a368821223ab admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=96c33d5332ef4343bbe9c1abb9f1ff62&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3478549 Nov 15 12:39:57.628898 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47168) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:39:57.678098 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d83296-04cb-4268-b7e0-a368821223ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a50b2b24-5b99-4606-9696-96cc59ecf708,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:57.712935 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:39:57.730831 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.762889 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.855785 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.863242 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:57.865002 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a50b2b24-5b99-4606-9696-96cc59ecf708 HTTP/1.1" status: 204 len: 168 time: 0.2350368 Nov 15 12:39:57.899875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b617c7-7623-4560-a781-d73d40ae72f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a50b2b24-5b99-4606-9696-96cc59ecf708,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:58.078250 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Request body: {'port': {'device_id': '5a60575a-1a5f-4803-a19e-47821edba597', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:39:58.084008 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=ecf51f4c-5ca7-49e7-96f3-5839637ce8f8,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:58.165580 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:39:58.169823 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Attempting to bind port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:39:58.214754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ab0196-543e-49e3-a932-3325e1af2a4e req-288c9b50-0698-4611-84c1-792023aa1524 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:58.226587 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-59ab0196-543e-49e3-a932-3325e1af2a4e req-288c9b50-0698-4611-84c1-792023aa1524 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 932 time: 0.2735980 Nov 15 12:39:58.420926 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-59ab0196-543e-49e3-a932-3325e1af2a4e req-15311705-3298-4ec3-9cdf-320a15a3f7b5 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1933374 Nov 15 12:39:58.475351 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca712cb3-9eb0-41e2-a300-d035a40c76d8 req-48dfd2e2-9013-4366-9699-e0c597055003 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3800893 Nov 15 12:39:58.508015 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:51Z', 'revision_number': 4, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '1704d939-fa50-440a-83ed-bcfa8264fa57', 'name': '', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'mac_address': 'fa:16:3e:92:0f:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:45Z', 'updated_at': '2021-11-15T12:39:57Z', 'revision_number': 4, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'subnets': [{'id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:39:58.542030 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:39:58.542552 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Checking segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:39:58.543204 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Bound using segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:39:58.543778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Bound port: 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:39:58.544262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:58.613972 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2af3de3-3a1e-42cc-bc71-9141bdc20d3c None None] The sync data for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi is: [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:51Z', 'revision_number': 4, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '1704d939-fa50-440a-83ed-bcfa8264fa57', 'name': '', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'mac_address': 'fa:16:3e:92:0f:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:45Z', 'updated_at': '2021-11-15T12:39:57Z', 'revision_number': 4, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'subnets': [{'id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:39:58.643631 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a390e931-174f-401f-95dc-d44266cacd06 req-63010a76-1457-4c91-ae19-468b38495927 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 210 time: 0.1004581 Nov 15 12:39:58.744984 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:58.762966 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:58.856577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:58.858015 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6f77711d-eb14-45fc-9a3b-560076b5ee47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 7.4518621 Nov 15 12:39:58.942226 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:39:59.023552 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:39:59.100007 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:59.333571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1704d939-fa50-440a-83ed-bcfa8264fa57 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:39:59.453622 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Pushing event updated for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:39:59.474795 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-001a87ac-41c6-49d8-88a3-71e3f8f586e8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-securitygroup--688600663&fields=id&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 267 time: 0.1969860 Nov 15 12:39:59.512044 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:59.512958 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:59.521741 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-a57f6a4d-4cc4-4667-8a3d-d3035c142b6e service neutron] 10.222.0.61 "PUT /v2.0/ports/1bf5cf4f-25e6-407d-8d56-f33732c6f670 HTTP/1.1" status: 200 len: 1094 time: 6.7423940 Nov 15 12:39:59.553079 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:39:59.832315 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340" -d '{"events": [{"name": "network-changed", "server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:39:59.879490 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-93a07e20-bfac-4b68-a3c3-860a8edc0e14 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:39:59.891263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 1704d939-fa50-440a-83ed-bcfa8264fa57 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:39:59.891829 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:39:59.912862 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-93a07e20-bfac-4b68-a3c3-860a8edc0e14 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 817 time: 0.4251451 Nov 15 12:39:59.943830 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-6f638c71-82a5-4599-a209-7409d0368bcb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/quotas/5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 375 time: 0.0288596 Nov 15 12:40:00.003712 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-11d8b7a5-ce1c-4177-b254-86a68355944e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:00.012278 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-11d8b7a5-ce1c-4177-b254-86a68355944e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 819 time: 0.9264905 Nov 15 12:40:00.022066 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-e443d10d-fde9-48f6-a8b7-1bb0e91b1199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:00.023567 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-e443d10d-fde9-48f6-a8b7-1bb0e91b1199 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 1097 time: 0.3627579 Nov 15 12:40:00.043342 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-51339901-4d17-46f2-bd51-874c502e74f5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0984914 Nov 15 12:40:00.088587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:00.144190 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 1704d939-fa50-440a-83ed-bcfa8264fa57, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1704d939-fa50-440a-83ed-bcfa8264fa57,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:00.156082 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:00.165425 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-30039fab-45d8-4052-8a29-bb9c41fd9194 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/quotas/71e17179085148bfacb8d235fc6ee668 HTTP/1.1" status: 200 len: 375 time: 0.1519432 Nov 15 12:40:00.183278 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.61', 61973) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:00.229616 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:00.286487 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-c80811e5-b071-4850-b40b-9bc8dbb3a716 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670 HTTP/1.1" status: 200 len: 217 time: 0.2297671 Nov 15 12:40:00.403518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5a0de-70f8-484b-9007-6b616612f001 req-d517acab-9430-48df-a8ff-324274a89e6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:00.406454 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-d517acab-9430-48df-a8ff-324274a89e6d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.0820904 Nov 15 12:40:00.502215 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-e2d377da-b174-4c4d-9126-9c54e19ea856 service neutron] 10.222.0.44 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4242833 Nov 15 12:40:00.531986 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-3cbe0201-4882-4a98-b62b-74d66d58165e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:00.534265 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-3cbe0201-4882-4a98-b62b-74d66d58165e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 819 time: 0.3498898 Nov 15 12:40:00.546083 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-0203a005-d02d-4947-9e23-17f038fffb3e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1311646 Nov 15 12:40:00.551127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:00.563632 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:00.600407 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Request body: {'port': {'device_id': '35af59c1-648d-4738-8273-1238b29f9a1b', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'admin_state_up': True, 'tenant_id': '71e17179085148bfacb8d235fc6ee668'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:00.611946 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-1276e571-ba50-4bca-b106-31035314e512 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4450037 Nov 15 12:40:00.664846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Transition to ACTIVE for port object cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:00.701445 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:00.800247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Pushing event updated for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:00.814203 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-ed0ed2a7-d83b-4994-9b86-7931860b48c4 service neutron] 10.222.0.44 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3053226 Nov 15 12:40:00.848106 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-c0c1f956-ad5a-443a-9200-dbeb8b35fec6 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2781296 Nov 15 12:40:00.852456 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-cbda8711-ae33-496a-b267-0004e862fd7f service neutron] 10.222.0.44 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2396004 Nov 15 12:40:00.924431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Made reservation on behalf of 71e17179085148bfacb8d235fc6ee668 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:40:00.931005 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:00.961622 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Attempting to bind port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:00.961957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Attempting to bind port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '42712e6e-6181-4ceb-bdda-98824d122256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:00.962720 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Attempting to bind port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 on network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:00.975757 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 on network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:00.976369 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Attempting to bind port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 on network 3102b790-5ced-465f-afa4-ed5c98c0e5d0 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:00.992284 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:00.992873 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Checking segment: {'id': '42712e6e-6181-4ceb-bdda-98824d122256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:00.993607 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Bound using segment: {'id': '42712e6e-6181-4ceb-bdda-98824d122256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:00.994234 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Bound port: cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '42712e6e-6181-4ceb-bdda-98824d122256', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:00.995250 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:01.050411 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-ab15ee1a-2e79-4140-8d7b-2f84c9bb0c69 service neutron] 10.222.0.44 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1798828 Nov 15 12:40:01.134154 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:01.141796 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,segment=NetworkSegment(42712e6e-6181-4ceb-bdda-98824d122256),segment_id=42712e6e-6181-4ceb-bdda-98824d122256)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:01.158914 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:01.269357 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1704d939-fa50-440a-83ed-bcfa8264fa57 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:01.279874 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Allocated IP 172.20.0.8 (4a1ca915-de15-4ccc-96e8-10f04d0723e3/ac24af71-ce9d-47b2-a800-8b7fc2391e39/08424d3d-6d1d-4f23-b097-340c6cd4f857) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:40:01.381915 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:01.384990 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:01.396787 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] 10.222.0.61 "PUT /v2.0/ports/cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 HTTP/1.1" status: 200 len: 1094 time: 3.3417027 Nov 15 12:40:01.440034 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 1704d939-fa50-440a-83ed-bcfa8264fa57 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:01.440638 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:01.538389 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e545db-fca4-46b5-a821-237c502c4c24 service neutron] Pushing event updated for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:01.600937 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad608cf8-eca1-4b73-b844-637f4033a25d req-387caebb-f59f-4a07-9d22-17b599adfd22 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:01.606406 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad608cf8-eca1-4b73-b844-637f4033a25d req-387caebb-f59f-4a07-9d22-17b599adfd22 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.2086654 Nov 15 12:40:01.694645 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:01.716338 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee0c59d-ab68-480d-bdfc-3e9e4b45dc04 req-65074d9a-4fb0-4323-a314-d6c3296203ce tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:01.725389 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bee0c59d-ab68-480d-bdfc-3e9e4b45dc04 req-65074d9a-4fb0-4323-a314-d6c3296203ce tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0912702 Nov 15 12:40:01.767950 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad608cf8-eca1-4b73-b844-637f4033a25d req-83beb4e4-e776-4289-99c6-fd09a45b92bb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440251 Nov 15 12:40:01.833743 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bee0c59d-ab68-480d-bdfc-3e9e4b45dc04 req-80b5f66c-2151-47fd-9551-3c9e3e7bccdf tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070240 Nov 15 12:40:01.842540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.050571 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-50824f83-83fe-4c11-a8a1-6976e729e901 req-33fa62a6-11dc-4f5b-a720-4f628602f63c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0778852 Nov 15 12:40:02.070742 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:40:02.079114 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:40:02.100303 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:40:02.105557 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Pushing event updated for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:02.165923 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:39:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07275900-4ea5-4319-bd59-6cb25ca56ab4 x-openstack-request-id: req-07275900-4ea5-4319-bd59-6cb25ca56ab4 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:02.166410 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:02.166800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-07275900-4ea5-4319-bd59-6cb25ca56ab4 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:02.167396 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670', 'status': 'completed', 'code': 200} Nov 15 12:40:02.185240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:02.185889 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.221662 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0904a0e2-e640-49ad-8cc0-e8a9c8ce3160 req-5b99a14d-9b99-438c-9e19-4cf9438bf404 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0327523 Nov 15 12:40:02.234289 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-ab63e275-af2e-4b47-b823-5e1d3b3d22a8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6442461 Nov 15 12:40:02.408692 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47364) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:02.513186 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b8bce6b-de7f-4447-bcab-16109f2de42e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.587219 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b8bce6b-de7f-4447-bcab-16109f2de42e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.590992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b8bce6b-de7f-4447-bcab-16109f2de42e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.634826 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8b8bce6b-de7f-4447-bcab-16109f2de42e admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=303e2ac731cc48928488294a9ffd29f7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2249830 Nov 15 12:40:02.635974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8bce6b-de7f-4447-bcab-16109f2de42e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9ebdcc4-38c1-4f30-a425-e9c3ab6def53,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:02.637969 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47368) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:02.688004 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.710572 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.757834 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.760541 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:02.761784 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a9ebdcc4-38c1-4f30-a425-e9c3ab6def53 HTTP/1.1" status: 204 len: 168 time: 0.1227715 Nov 15 12:40:02.776992 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d674ef-decc-4d6c-abb4-b65da64081ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9ebdcc4-38c1-4f30-a425-e9c3ab6def53,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:02.957010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347d3ecb-c740-423c-b94c-344d1461133e req-b6aa1195-6bd0-47f2-a76e-618840cb2c98 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:02.958776 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-347d3ecb-c740-423c-b94c-344d1461133e req-b6aa1195-6bd0-47f2-a76e-618840cb2c98 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0543094 Nov 15 12:40:03.014598 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-347d3ecb-c740-423c-b94c-344d1461133e req-fa2bf8e9-82b9-44ec-9162-34e76e103430 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484760 Nov 15 12:40:03.052560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2900b680-0436-4169-bcbb-482f4d606769 req-88bca07d-f6e5-4576-90a7-190d50999a53 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:03.054100 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2900b680-0436-4169-bcbb-482f4d606769 req-88bca07d-f6e5-4576-90a7-190d50999a53 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.2190235 Nov 15 12:40:03.064571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47382) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:03.078374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-490dccc6-4e46-456d-9362-0d35208c1a63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.107465 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2900b680-0436-4169-bcbb-482f4d606769 req-31475acc-b721-412c-a8c5-13d8cfa8ca04 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471413 Nov 15 12:40:03.186085 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-490dccc6-4e46-456d-9362-0d35208c1a63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.188820 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5be2dbde-cd5a-4bbc-8822-3fffc06d2764 req-6859144f-00cd-4d28-a5c3-5021c66d032f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0360808 Nov 15 12:40:03.191047 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-490dccc6-4e46-456d-9362-0d35208c1a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.228956 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490dccc6-4e46-456d-9362-0d35208c1a63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33e33216-ee3a-41e7-860d-72f241856ad6,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:03.238305 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-490dccc6-4e46-456d-9362-0d35208c1a63 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=18b6213e592545b0b82aef2ffe395c78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1725183 Nov 15 12:40:03.241556 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47388) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:03.291244 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.314853 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.316878 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74695150-be3b-43a9-9d89-508a0c6ddd66 req-4fd04230-1f63-417e-8ef0-9c5d98390194 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0263002 Nov 15 12:40:03.322054 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-06018334-97c9-4423-af97-ede05cce9745 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.370419 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.373099 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:03.374249 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/33e33216-ee3a-41e7-860d-72f241856ad6 HTTP/1.1" status: 204 len: 168 time: 0.1317973 Nov 15 12:40:03.382620 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33e9f95-dee0-4705-be85-0b7661755c3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33e33216-ee3a-41e7-860d-72f241856ad6,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:03.736949 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Request body: {'port': {'device_id': '35af59c1-648d-4738-8273-1238b29f9a1b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:03.739556 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48e5a0de-70f8-484b-9007-6b616612f001 req-197f48cd-9a63-43b6-8257-6d0d646f50ee service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1202950 Nov 15 12:40:03.871169 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.007060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-5dd42190-0236-4123-8807-efb64fe9a2bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:04.009057 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-5dd42190-0236-4123-8807-efb64fe9a2bf service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9273dacda2824318a7e6d2acf9f295ba&device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 1097 time: 0.0563626 Nov 15 12:40:04.138575 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-960f2471-22e9-423e-98b5-0fe7bd4304be service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 HTTP/1.1" status: 200 len: 217 time: 0.0811419 Nov 15 12:40:04.168357 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:04.171303 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5" -d '{"events": [{"name": "network-changed", "server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:04.188802 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-80bb5ece-f47b-47bb-b1ee-eb4c76f518f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:04.190660 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-80bb5ece-f47b-47bb-b1ee-eb4c76f518f3 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 1097 time: 0.1143525 Nov 15 12:40:04.256877 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5157ee2-638e-418e-a932-a78a87ad993e req-a2aabeea-3870-457c-8b6c-2ba681aa5031 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:04.264659 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e5157ee2-638e-418e-a932-a78a87ad993e req-a2aabeea-3870-457c-8b6c-2ba681aa5031 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0713885 Nov 15 12:40:04.265629 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c643ff3-2b8c-4ce7-b888-dfd41f155d60 req-2110baf5-6947-4027-a147-f1c0a4e0bb22 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:04.267148 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c643ff3-2b8c-4ce7-b888-dfd41f155d60 req-2110baf5-6947-4027-a147-f1c0a4e0bb22 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.1091883 Nov 15 12:40:04.332584 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e5157ee2-638e-418e-a932-a78a87ad993e req-c089f08a-128d-4bc9-a990-cf7f05732b4c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511067 Nov 15 12:40:04.367240 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c643ff3-2b8c-4ce7-b888-dfd41f155d60 req-2e6893ba-15ab-499e-a69d-f8434dbfc37f tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891008 Nov 15 12:40:04.373270 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 08424d3d-6d1d-4f23-b097-340c6cd4f857 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:04.382385 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47fcc20d-f496-4313-bad1-dcd99f8288da x-openstack-request-id: req-47fcc20d-f496-4313-bad1-dcd99f8288da {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:04.382674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:04.382926 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-47fcc20d-f496-4313-bad1-dcd99f8288da {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:04.383325 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820', 'status': 'completed', 'code': 200} Nov 15 12:40:04.390977 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.413358 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Transition to ACTIVE for port object 08424d3d-6d1d-4f23-b097-340c6cd4f857 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:04.418694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.480779 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Pushing event updated for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:04.488809 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-21ec754b-24b6-425e-a427-9e227628fa62 req-1eb73a5a-7e11-4b2a-99d5-d96ffcd55a7e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0390887 Nov 15 12:40:04.537157 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-09498329-fa04-459e-93a0-60e92698a2f1 req-981fc985-ab4c-4d7d-b6a9-5b4c6d0eb689 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0571177 Nov 15 12:40:04.609367 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Attempting to bind port 08424d3d-6d1d-4f23-b097-340c6cd4f857 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:04.609737 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Attempting to bind port 08424d3d-6d1d-4f23-b097-340c6cd4f857 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:04.610095 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Attempting to bind port 08424d3d-6d1d-4f23-b097-340c6cd4f857 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:04.615150 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Port 08424d3d-6d1d-4f23-b097-340c6cd4f857 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:04.615446 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Attempting to bind port 08424d3d-6d1d-4f23-b097-340c6cd4f857 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:04.620500 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 39, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:04.620855 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Checking segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:04.621410 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Bound using segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:04.621858 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Bound port: 08424d3d-6d1d-4f23-b097-340c6cd4f857, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:04.622211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.691334 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:04.696000 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:04.700802 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.745799 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:04.746423 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:04.747848 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] 10.222.0.61 "PUT /v2.0/ports/08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 1093 time: 1.0187438 Nov 15 12:40:04.748327 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:04.780181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ebd79f-8861-4a4e-8942-ecddbc0c0a35 service neutron] Pushing event updated for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:04.887182 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfd16b72-88ae-4739-84ae-62c86d21a48d" -d '{"events": [{"name": "network-changed", "server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:05.052359 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-742c1871-ed3d-4c67-8d56-456ce7dbdaf1 x-openstack-request-id: req-742c1871-ed3d-4c67-8d56-456ce7dbdaf1 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:05.052909 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:05.053162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-742c1871-ed3d-4c67-8d56-456ce7dbdaf1 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:05.053606 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857', 'status': 'completed', 'code': 200} Nov 15 12:40:05.457244 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89070f6-f1df-412d-b436-c4752cab0af0 req-37ded6e5-c2fd-4513-a358-50a736c77858 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:05.465091 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a89070f6-f1df-412d-b436-c4752cab0af0 req-37ded6e5-c2fd-4513-a358-50a736c77858 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0719748 Nov 15 12:40:05.516922 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a89070f6-f1df-412d-b436-c4752cab0af0 req-1c3d86f0-8c44-4857-a249-2d9f0f5af686 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505850 Nov 15 12:40:05.538851 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f442173-9133-4a0f-8206-dd6990dd2ed1 req-1e29b262-221b-46f9-9778-0e6d1e89f405 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:05.540436 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2f442173-9133-4a0f-8206-dd6990dd2ed1 req-1e29b262-221b-46f9-9778-0e6d1e89f405 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0599639 Nov 15 12:40:05.605513 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2f442173-9133-4a0f-8206-dd6990dd2ed1 req-996c79f6-ba7f-4288-b9fd-30b4d8ead1f3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586991 Nov 15 12:40:05.611104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7b2f885a-10b7-4d0b-8b7d-a85c397b838b req-aea7ec82-006d-407f-8276-abdd45c1723b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0380633 Nov 15 12:40:05.688381 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b70430f6-e1ee-4b37-ad76-3d0c0ff3beae req-79ed379d-f325-4e03-ba57-dd7882069a54 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0256357 Nov 15 12:40:05.738248 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-18a19105-ea66-48c8-b53a-c45780affe38 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:06.627356 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a91d646-9aa6-46ce-9a90-57f11e2dbd66 req-d6679820-4c5a-434b-a508-f0b634bba651 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:06.628875 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5a91d646-9aa6-46ce-9a90-57f11e2dbd66 req-d6679820-4c5a-434b-a508-f0b634bba651 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0486305 Nov 15 12:40:06.678147 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5a91d646-9aa6-46ce-9a90-57f11e2dbd66 req-5b7cc156-624f-4b4f-8a48-2a05cc51cc6d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422513 Nov 15 12:40:06.723499 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fc2a89-1581-40fe-ba78-a53e02430e9c req-103d7826-7e60-49cf-a0ed-65f8898922f3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:06.725663 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61fc2a89-1581-40fe-ba78-a53e02430e9c req-103d7826-7e60-49cf-a0ed-65f8898922f3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0506699 Nov 15 12:40:06.761413 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6aa396b6-757c-40b0-992d-aa2cf74a5573 req-bc336ab6-bea2-4978-9b9e-1dfdcb0586b9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0265875 Nov 15 12:40:06.777324 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61fc2a89-1581-40fe-ba78-a53e02430e9c req-8da27385-e49a-411a-9894-9e5d5ad27e42 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455115 Nov 15 12:40:06.831514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:06.851934 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8b767da0-dd2b-42b3-a8ea-5dd1f50f9cc5 req-8bd3cf74-ebc3-4eba-8732-700811698dd0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0298901 Nov 15 12:40:07.175326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-3521b93a-b2b0-4a5b-827a-c994ab52fc3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.178003 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-3521b93a-b2b0-4a5b-827a-c994ab52fc3b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1096 time: 0.0923026 Nov 15 12:40:07.198583 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-a434a6db-1d0d-4d92-a103-685242e4ef05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.200078 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-a434a6db-1d0d-4d92-a103-685242e4ef05 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d52c5911-a606-4287-aa04-2d2021b05259 HTTP/1.1" status: 200 len: 851 time: 0.1379471 Nov 15 12:40:07.279910 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-2e2ab331-82b2-48d1-85be-0a21f4abe1d5 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=3102b790-5ced-465f-afa4-ed5c98c0e5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0553701 Nov 15 12:40:07.356600 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-32df7a9a-47b5-4977-8699-cc284242dee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.358092 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-32df7a9a-47b5-4977-8699-cc284242dee3 service neutron] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 916 time: 0.2866418 Nov 15 12:40:07.430089 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-193c4021-be78-4163-a2ff-3c569afc4142 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670 HTTP/1.1" status: 200 len: 217 time: 0.0618424 Nov 15 12:40:07.467756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-f456ae0c-99fc-485e-a9fc-ad2fdf56f91e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.472223 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-f456ae0c-99fc-485e-a9fc-ad2fdf56f91e service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=71e17179085148bfacb8d235fc6ee668&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2682350 Nov 15 12:40:07.494828 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-879b0d6c-f695-4806-a848-f1c2ac0707ba service neutron] 10.222.0.61 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2048984 Nov 15 12:40:07.545286 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-d0005c4f-b277-4e14-87f2-cf753eb72f80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.547841 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-d0005c4f-b277-4e14-87f2-cf753eb72f80 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.1035163 Nov 15 12:40:07.709798 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-40578689-e9d9-48fe-b5f9-065778ac7dea service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0698209 Nov 15 12:40:07.761515 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77b5fa45-f599-4bb0-b917-e1276d2ef531 req-ccac8854-095a-4065-93d3-57a08dec2a1f service neutron] 10.222.0.61 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2533920 Nov 15 12:40:07.946025 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e847039-f077-4ee5-b1d4-d570cc5893e0 req-51db6510-d881-41c4-9050-aeaeb7730f65 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:07.947669 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3e847039-f077-4ee5-b1d4-d570cc5893e0 req-51db6510-d881-41c4-9050-aeaeb7730f65 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0826318 Nov 15 12:40:07.953082 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f45f0f1b-b6a1-4b05-b14c-c53ab36fea56 req-15771eb5-b6c4-4b21-8663-af7ebea1b216 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0617018 Nov 15 12:40:08.004090 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-1655a791-2d1c-4863-93a0-8dd6005c6038 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:08.004614 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-03cc6d2a-4f62-4e96-8728-7eb4b4632387 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2728720 Nov 15 12:40:08.006124 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bfd16b72-88ae-4739-84ae-62c86d21a48d req-1655a791-2d1c-4863-93a0-8dd6005c6038 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5208981 Nov 15 12:40:08.009080 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3e847039-f077-4ee5-b1d4-d570cc5893e0 req-e084e5cd-ebcd-4291-8e06-1f365150c004 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518343 Nov 15 12:40:08.096277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722c6452-48ea-4d5c-ba7a-16f5de92689c req-cb94fd9c-ecef-4c9f-990c-316a167ad4b1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:08.097910 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-722c6452-48ea-4d5c-ba7a-16f5de92689c req-cb94fd9c-ecef-4c9f-990c-316a167ad4b1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0551312 Nov 15 12:40:08.109795 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9183e64b-006c-4020-916f-02810e174bce req-bb67ed70-0472-4263-94cf-1c3f647fb941 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0287654 Nov 15 12:40:08.158044 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-722c6452-48ea-4d5c-ba7a-16f5de92689c req-d4b74d03-6831-4833-8755-b013135afe69 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532835 Nov 15 12:40:08.287883 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:09.080395 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d66c4e25-ee35-4e8d-b6b0-257b2ba30749 req-25fd8152-665c-4434-b822-73c68cfcd87a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0269315 Nov 15 12:40:09.110501 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:09.130495 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-530ad588-171e-4e25-a326-83069455d7ab req-7df8ccbb-7a0c-4313-8ae9-dad2c987b424 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:09.132064 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-530ad588-171e-4e25-a326-83069455d7ab req-7df8ccbb-7a0c-4313-8ae9-dad2c987b424 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0526595 Nov 15 12:40:09.186994 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-530ad588-171e-4e25-a326-83069455d7ab req-d64a9b66-9477-476c-b756-a6c3d226cfe0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486042 Nov 15 12:40:09.220591 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-13d6d6af-0008-4952-9398-d20e33c84ccf req-2ea5fd71-7efc-446c-b201-b9ca5a3f423a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0313807 Nov 15 12:40:09.310702 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d9ca40-7c11-4a96-9847-ca43d0a7b639 req-b37fcaee-226a-4e19-a5c0-29aeaafba94d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:09.312213 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28d9ca40-7c11-4a96-9847-ca43d0a7b639 req-b37fcaee-226a-4e19-a5c0-29aeaafba94d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0490687 Nov 15 12:40:09.359120 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28d9ca40-7c11-4a96-9847-ca43d0a7b639 req-2df2eed3-4a68-4d63-9b21-ae56974c13a4 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407948 Nov 15 12:40:10.182606 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8091ecd-5cb9-4971-81b1-dbf03404ad61 req-4d7927c2-9ea4-44b8-accb-4c70e5ebc420 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0265493 Nov 15 12:40:10.305462 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcddf267-12a4-4f2f-abdb-551fd2f99db3 req-9eb6234d-e450-42fe-abf7-2afd18c25906 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:10.306994 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fcddf267-12a4-4f2f-abdb-551fd2f99db3 req-9eb6234d-e450-42fe-abf7-2afd18c25906 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.0493333 Nov 15 12:40:10.315695 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8b3d0b7-97b1-4d55-8ecc-e4d1addd191e req-0091435b-b157-4d79-95d5-0cb47a49b2b4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.0296369 Nov 15 12:40:10.356897 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fcddf267-12a4-4f2f-abdb-551fd2f99db3 req-661f2752-1c30-442a-89b9-55a85a84194f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440295 Nov 15 12:40:10.473848 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b9e679-53be-4a29-bc4a-0e9bf8f92067 req-d30b63f1-abf3-4207-acc6-d76a77ea0213 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:10.475318 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-26b9e679-53be-4a29-bc4a-0e9bf8f92067 req-d30b63f1-abf3-4207-acc6-d76a77ea0213 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0496087 Nov 15 12:40:10.522526 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-26b9e679-53be-4a29-bc4a-0e9bf8f92067 req-fa4e31b5-20d8-459c-9a8a-1eb1ff2d9129 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412517 Nov 15 12:40:10.830351 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e960d6dd-8bc1-4b02-9ee4-56bf4bb45340 req-acc26782-4fb6-40c0-bd93-d2bd6740f920 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1096153 Nov 15 12:40:11.037027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-817de6ec-0497-401c-8fec-50fecb61d9d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.039455 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-817de6ec-0497-401c-8fec-50fecb61d9d9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9273dacda2824318a7e6d2acf9f295ba&device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 1097 time: 0.1419291 Nov 15 12:40:11.051416 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-93746548-b629-4df4-b442-def435dfb028 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.054352 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-93746548-b629-4df4-b442-def435dfb028 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1096 time: 0.1546187 Nov 15 12:40:11.094361 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-a1b87c61-a384-463a-98d6-5f048b8d4193 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.100893 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-a1b87c61-a384-463a-98d6-5f048b8d4193 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 819 time: 0.2099257 Nov 15 12:40:11.161880 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Request body: {'port': {'device_id': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'admin_state_up': True, 'tenant_id': '71e17179085148bfacb8d235fc6ee668'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:11.198091 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-2f6db61f-74af-4082-82d6-68f3c41533bd service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.1123157 Nov 15 12:40:11.346876 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-973740bf-65f0-4d7f-b682-f29071853a32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.347609 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dd5e37e2-9c08-4bd6-932c-4e45841eeaf0 req-8f0a5c10-0c80-4ce4-96db-535466a76a13 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0562334 Nov 15 12:40:11.359267 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-973740bf-65f0-4d7f-b682-f29071853a32 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.1341841 Nov 15 12:40:11.396926 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-e1fe5c0e-28cd-403f-97b7-1c5a39dcf5e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.406422 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-e1fe5c0e-28cd-403f-97b7-1c5a39dcf5e9 service neutron] 10.222.0.61 "GET /v2.0/networks?id=3102b790-5ced-465f-afa4-ed5c98c0e5d0 HTTP/1.1" status: 200 len: 912 time: 0.3505514 Nov 15 12:40:11.459658 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Made reservation on behalf of 71e17179085148bfacb8d235fc6ee668 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:40:11.463980 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:11.488358 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-4ee22077-e613-400e-ace1-7b9ae3a44d33 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0802486 Nov 15 12:40:11.646975 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d26fa7a-251d-410a-bc9b-4c7faa9f5ae3 req-f4974c99-f637-4768-8efe-82419bdbdfb9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.650036 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0d26fa7a-251d-410a-bc9b-4c7faa9f5ae3 req-f4974c99-f637-4768-8efe-82419bdbdfb9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.1602795 Nov 15 12:40:11.656787 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.61', 61998) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:11.733404 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-25ed4a51-85a2-4b23-8ffa-c50b9f5b820b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 HTTP/1.1" status: 200 len: 217 time: 0.2879937 Nov 15 12:40:11.745320 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6f9aacf2-20ab-415d-af47-6351608f7192 req-8c3550cb-50d8-4c37-9681-287551900a79 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.2559261 Nov 15 12:40:11.837133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Allocated IP 172.20.0.3 (4a1ca915-de15-4ccc-96e8-10f04d0723e3/ac24af71-ce9d-47b2-a800-8b7fc2391e39/b9ecf6e8-fd12-4b4f-9471-efed756013e7) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:40:11.883120 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0d26fa7a-251d-410a-bc9b-4c7faa9f5ae3 req-45d6178a-adc9-45da-8609-a9f56e06c646 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1803031 Nov 15 12:40:11.927864 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-dc996fcc-c657-4627-ab33-3c4ef46ebd99 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.930218 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-dc996fcc-c657-4627-ab33-3c4ef46ebd99 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 817 time: 0.2719431 Nov 15 12:40:11.935455 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-1473178e-5bbf-412b-9626-c8241070c0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.937015 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-1473178e-5bbf-412b-9626-c8241070c0c9 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d52c5911-a606-4287-aa04-2d2021b05259 HTTP/1.1" status: 200 len: 851 time: 0.1438012 Nov 15 12:40:11.964991 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c0aa44-6bb3-4691-aa82-0717ea3e1e11 req-9ee10c78-15d6-4857-9505-e5c5109a6c5b tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:11.967009 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6c0aa44-6bb3-4691-aa82-0717ea3e1e11 req-9ee10c78-15d6-4857-9505-e5c5109a6c5b tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.1161199 Nov 15 12:40:11.980336 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-22f27d32-75be-4afc-a511-5767376af479 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4439049 Nov 15 12:40:12.017007 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-d676e0fc-9073-4c4a-885f-707a3e2e078d service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=3102b790-5ced-465f-afa4-ed5c98c0e5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0485432 Nov 15 12:40:12.080320 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.114758 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-12cb8acb-3b46-400c-ba7a-050b4b73cbbd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 379 time: 0.1481364 Nov 15 12:40:12.132713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'port': {'device_id': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'admin_state_up': True, 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'security_groups': ['da4a15c8-b16c-4a62-801f-33492179f865']}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:12.186244 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.206365 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6c0aa44-6bb3-4691-aa82-0717ea3e1e11 req-4c16364d-e5ff-444b-a381-a40ae1c8b0b3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2234292 Nov 15 12:40:12.317621 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a140b87-8460-4a6d-9763-367fc6decf04 req-b7ef13b4-de5f-429c-81bd-4e91feab4c59 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3153408 Nov 15 12:40:12.326509 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.358622 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-df46520c-8c9f-4083-bd4b-1bdfdfdcb235 service neutron] 10.222.0.61 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3195608 Nov 15 12:40:12.397486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Pushing event updated for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:12.403637 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Made reservation on behalf of 5e23e880e5674cdb85e83c616f14f549 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:40:12.407881 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.427338 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:40:12.440500 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:40:12.446783 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:40:12.589014 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a314fe84-5d3e-4e43-9e0b-b15f1af00cd5 req-4031f1ee-e292-44e5-8d90-8d159aa6317b service neutron] 10.222.0.61 "GET /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1594439 Nov 15 12:40:12.593696 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a943b2e0-cd08-475f-97c4-dc423316f09d req-39ec5778-e91b-4d55-a18d-09df70fff6d2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0613456 Nov 15 12:40:12.680453 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47662) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:12.692873 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:12.693592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.720184 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-9e1ac476-d970-4a0e-b039-67855a3f2b15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5724061 Nov 15 12:40:12.768996 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Request body: {'port': {'device_id': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:12.843981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Allocated IP 172.20.0.4 (7e6e34e4-b05e-4c98-9266-31ca11e16a97/45ee91be-922e-4559-8cc0-d7bba19c0c19/36928b8a-e800-43e0-9edd-e13ae44ee93e) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:40:12.867748 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:12.986384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633e0e61-c09d-4e6e-a00f-191d58f03586 req-d240b4b0-f521-4993-b268-595a5b651ed9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:12.988012 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-633e0e61-c09d-4e6e-a00f-191d58f03586 req-d240b4b0-f521-4993-b268-595a5b651ed9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 931 time: 0.1192992 Nov 15 12:40:13.071317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c95d18c1-9f8f-466d-bac2-bcdf55e062f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.114044 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-633e0e61-c09d-4e6e-a00f-191d58f03586 req-2fd67722-f9f5-48c3-b3a7-9c6c2cdac5ba tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104872 Nov 15 12:40:13.227022 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c95d18c1-9f8f-466d-bac2-bcdf55e062f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.241778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c95d18c1-9f8f-466d-bac2-bcdf55e062f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.323511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95d18c1-9f8f-466d-bac2-bcdf55e062f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2406a711-f409-4486-9e59-a250fd11435a,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:13.327984 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c95d18c1-9f8f-466d-bac2-bcdf55e062f4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=bdbb81c285934059bb1481ec710a9045&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6340132 Nov 15 12:40:13.330799 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47680) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:13.389107 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.407482 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c035dc45-21cb-486a-97c7-5fdad67bcc22 req-6a439b20-806c-4119-8d37-1a07d2bf6e6c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:13.415140 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7de0e63-3dd0-4342-8452-44dd9feafe3a req-8b556eef-323a-441f-9604-9525c0594166 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:13.415381 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c035dc45-21cb-486a-97c7-5fdad67bcc22 req-6a439b20-806c-4119-8d37-1a07d2bf6e6c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 944 time: 0.2854879 Nov 15 12:40:13.422627 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e7de0e63-3dd0-4342-8452-44dd9feafe3a req-8b556eef-323a-441f-9604-9525c0594166 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.1002793 Nov 15 12:40:13.460921 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.504090 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.516917 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e7de0e63-3dd0-4342-8452-44dd9feafe3a req-18260974-040b-424b-9bba-65dc6b2ea489 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931582 Nov 15 12:40:13.595979 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.599746 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.601219 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2406a711-f409-4486-9e59-a250fd11435a HTTP/1.1" status: 204 len: 168 time: 0.2691162 Nov 15 12:40:13.612883 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e0bf05-0462-4e41-9b6d-08b8ed28c3b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2406a711-f409-4486-9e59-a250fd11435a,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:13.748930 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-137ebec8-6f4b-4413-a32e-0cd660fc6d2e req-7a1447a6-9e86-4cf1-b8d0-3a45912aafd5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0341480 Nov 15 12:40:13.794979 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c035dc45-21cb-486a-97c7-5fdad67bcc22 req-cf391bfd-2df7-45d8-b134-10804f716f25 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3788233 Nov 15 12:40:13.835893 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.893933 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b9ecf6e8-fd12-4b4f-9471-efed756013e7 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:13.916007 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:13.920768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:40:13.925830 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:40:13.935284 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:40:13.965679 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:13.968559 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Transition to ACTIVE for port object b9ecf6e8-fd12-4b4f-9471-efed756013e7 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:13.989962 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.007338 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 1bf5cf4f-25e6-407d-8d56-f33732c6f670 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:14.116528 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Pushing event updated for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:14.124950 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.125662 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.166466 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-f7e2b12b-0525-4cb3-8fcc-2b8ddc8962be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0401652 Nov 15 12:40:14.201608 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:14.220164 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '1bf5cf4f-25e6-407d-8d56-f33732c6f670', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'port_id': '1bf5cf4f-25e6-407d-8d56-f33732c6f670', 'mac_address': 'fa:16:3e:f8:75:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 647, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65d6a75d-c74e-4d29-a0f1-5b5b6db06715', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:14.242685 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Attempting to bind port b9ecf6e8-fd12-4b4f-9471-efed756013e7 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:14.243427 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Attempting to bind port b9ecf6e8-fd12-4b4f-9471-efed756013e7 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:14.243932 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Attempting to bind port b9ecf6e8-fd12-4b4f-9471-efed756013e7 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:14.263681 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Port b9ecf6e8-fd12-4b4f-9471-efed756013e7 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:14.264021 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Attempting to bind port b9ecf6e8-fd12-4b4f-9471-efed756013e7 on network 4a1ca915-de15-4ccc-96e8-10f04d0723e3 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:14.270950 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 40, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:14.271297 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Checking segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:14.271689 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Bound using segment: {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:14.272166 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Bound port: b9ecf6e8-fd12-4b4f-9471-efed756013e7, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5488729b-f428-45a7-86f4-5ade62111aad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:14.272520 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.280660 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.306679 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1bf5cf4f-25e6-407d-8d56-f33732c6f670 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:14.333310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:14.342972 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.345850 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:14.360612 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990fae82-7e58-4859-8877-03522f7823fc req-6032f5ec-c06d-44aa-ad14-049d0d77548a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.365519 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-990fae82-7e58-4859-8877-03522f7823fc req-6032f5ec-c06d-44aa-ad14-049d0d77548a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.0724897 Nov 15 12:40:14.412531 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:14.425642 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:14.430113 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-5a5c23d3-6fdb-473f-9bc7-820b63cae5fb None None] Provisioning complete for port 36928b8a-e800-43e0-9edd-e13ae44ee93e triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:14.430840 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5a5c23d3-6fdb-473f-9bc7-820b63cae5fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.433360 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.447211 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-990fae82-7e58-4859-8877-03522f7823fc req-47b4d9dd-c406-4853-8c78-8e8063d2bdbb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727618 Nov 15 12:40:14.521682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.522308 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.524572 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] 10.222.0.61 "PUT /v2.0/ports/b9ecf6e8-fd12-4b4f-9471-efed756013e7 HTTP/1.1" status: 200 len: 1093 time: 1.7621102 Nov 15 12:40:14.525262 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:14.527754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4" -d '{"events": [{"name": "network-changed", "server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:14.532247 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:14.542101 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-5a5c23d3-6fdb-473f-9bc7-820b63cae5fb None None] Port 36928b8a-e800-43e0-9edd-e13ae44ee93e cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:40:14.550525 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1048aa1-d37a-46ad-84ad-c604a428fc6d service neutron] Pushing event updated for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:14.586575 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,segment=NetworkSegment(42712e6e-6181-4ceb-bdda-98824d122256),segment_id=42712e6e-6181-4ceb-bdda-98824d122256)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:14.610456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820', 'network_id': '3102b790-5ced-465f-afa4-ed5c98c0e5d0', 'port_id': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820', 'mac_address': 'fa:16:3e:0a:0b:85', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd52c5911-a606-4287-aa04-2d2021b05259', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:14.650636 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10815fb3-4b96-4bf8-8e12-36ab65aba87d x-openstack-request-id: req-10815fb3-4b96-4bf8-8e12-36ab65aba87d {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:14.650931 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:14.651180 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-10815fb3-4b96-4bf8-8e12-36ab65aba87d {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:14.651765 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7', 'status': 'completed', 'code': 200} Nov 15 12:40:14.665264 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.668546 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ddc413-4884-4686-ab73-f94d4aeee079 req-c678e8d1-f136-465d-974f-a3fd85aed154 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.670144 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f8ddc413-4884-4686-ab73-f94d4aeee079 req-c678e8d1-f136-465d-974f-a3fd85aed154 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 944 time: 0.0585191 Nov 15 12:40:14.684723 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:14.711920 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,segment=NetworkSegment(42712e6e-6181-4ceb-bdda-98824d122256),segment_id=42712e6e-6181-4ceb-bdda-98824d122256)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:14.717884 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:14.733763 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f8ddc413-4884-4686-ab73-f94d4aeee079 req-d31691cc-4ea3-4ce3-9ea2-b83cbc0194f5 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522084 Nov 15 12:40:14.771006 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:14.883959 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bbc2d37-3c43-4666-a20c-aa37f420b583 req-328d0c49-31db-4eb8-a4ee-593e498a3d04 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.886308 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9bbc2d37-3c43-4666-a20c-aa37f420b583 req-328d0c49-31db-4eb8-a4ee-593e498a3d04 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 931 time: 0.0549567 Nov 15 12:40:14.951602 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9bbc2d37-3c43-4666-a20c-aa37f420b583 req-9b08e245-18ae-4ed2-9e85-f88b6eddb8ba tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584300 Nov 15 12:40:14.958495 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b635c40-231e-4830-bf3b-d10289761e61 req-630c25c5-9655-429f-8730-cb23c4c456bd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:14.961018 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1b635c40-231e-4830-bf3b-d10289761e61 req-630c25c5-9655-429f-8730-cb23c4c456bd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.0719547 Nov 15 12:40:15.028043 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1b635c40-231e-4830-bf3b-d10289761e61 req-69677362-35f2-475e-a9a5-afdd62db3b59 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582933 Nov 15 12:40:15.578650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ebd3f3-57d5-4a5f-89b5-97061b1d27f0 req-d93f599f-d2fd-4b81-ad38-c50e9f5b8d58 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:15.580261 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a5ebd3f3-57d5-4a5f-89b5-97061b1d27f0 req-d93f599f-d2fd-4b81-ad38-c50e9f5b8d58 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.0542941 Nov 15 12:40:15.636084 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a5ebd3f3-57d5-4a5f-89b5-97061b1d27f0 req-cba80ad0-cdce-415c-a051-2e8d51e4e5f8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495605 Nov 15 12:40:15.854033 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f9d12d-c7c8-4c01-860c-2674f91ce039 req-030fdbf0-3a7f-467c-af63-c853e9aca1d3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:15.855867 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8f9d12d-c7c8-4c01-860c-2674f91ce039 req-030fdbf0-3a7f-467c-af63-c853e9aca1d3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.0560911 Nov 15 12:40:15.918879 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8f9d12d-c7c8-4c01-860c-2674f91ce039 req-c78cad4b-ae18-4f0d-90e0-a62f25fe3884 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531135 Nov 15 12:40:16.099335 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7501b5af-4f94-42d0-82c3-40bba9b4b6f7 req-e6ba05ed-90c4-404a-b0f1-6e4947c3a7b0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:16.102481 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7501b5af-4f94-42d0-82c3-40bba9b4b6f7 req-e6ba05ed-90c4-404a-b0f1-6e4947c3a7b0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 931 time: 0.0700691 Nov 15 12:40:16.159805 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7501b5af-4f94-42d0-82c3-40bba9b4b6f7 req-d4e19753-7343-4c3f-8ff5-a30a62b236bd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492959 Nov 15 12:40:16.171061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5b8b83-ec31-4e5d-ac71-f81ad5c5a3b3 req-190ace33-7bc0-4531-93f6-24ca7d2f98fb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:16.172752 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3b5b8b83-ec31-4e5d-ac71-f81ad5c5a3b3 req-190ace33-7bc0-4531-93f6-24ca7d2f98fb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.0570962 Nov 15 12:40:16.227738 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3b5b8b83-ec31-4e5d-ac71-f81ad5c5a3b3 req-cc002d4f-82f0-4578-b58a-7fc4549351e0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475085 Nov 15 12:40:16.754313 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82175cf2-42ac-45f6-94bd-a44f13b35a7f req-46e402bf-66d2-468f-a041-8bff737e3ec5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:16.756368 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-82175cf2-42ac-45f6-94bd-a44f13b35a7f req-46e402bf-66d2-468f-a041-8bff737e3ec5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.0527368 Nov 15 12:40:16.759174 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:40:16.805325 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-82175cf2-42ac-45f6-94bd-a44f13b35a7f req-732f4cb5-e4e7-42cf-b3eb-b23894646c2d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427487 Nov 15 12:40:16.914591 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Request body: {'port': {'device_id': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:16.973361 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 08424d3d-6d1d-4f23-b097-340c6cd4f857 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:17.019844 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:17.069635 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-dd7631e1-c8f5-4790-b596-df7b851381e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.071346 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-dd7631e1-c8f5-4790-b596-df7b851381e9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1096 time: 0.0860746 Nov 15 12:40:17.078387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdb6340-aeeb-419f-bff9-01fc8ad8d3fd req-2a31eda4-572b-4897-9094-9ea29a25dc18 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.080069 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ffdb6340-aeeb-419f-bff9-01fc8ad8d3fd req-2a31eda4-572b-4897-9094-9ea29a25dc18 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.0713310 Nov 15 12:40:17.121661 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:17.142177 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '08424d3d-6d1d-4f23-b097-340c6cd4f857', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'port_id': '08424d3d-6d1d-4f23-b097-340c6cd4f857', 'mac_address': 'fa:16:3e:23:56:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 641, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:17.155516 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ffdb6340-aeeb-419f-bff9-01fc8ad8d3fd req-d7b80d2c-7f5b-4fef-a218-998125e92991 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688448 Nov 15 12:40:17.203637 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:17.224528 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 08424d3d-6d1d-4f23-b097-340c6cd4f857 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:17.258651 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:17.289722 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:17.297990 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-26572acc-0804-4c2a-8e35-55be7b0c1af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.299517 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-26572acc-0804-4c2a-8e35-55be7b0c1af6 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=71e17179085148bfacb8d235fc6ee668&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2060142 Nov 15 12:40:17.356273 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:17.380972 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587e049a-1983-4e88-a7d0-218818419dd2 req-7af12dfc-1472-4de2-833a-e1a4f9bf71d2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.386331 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-587e049a-1983-4e88-a7d0-218818419dd2 req-7af12dfc-1472-4de2-833a-e1a4f9bf71d2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.0700893 Nov 15 12:40:17.466699 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-587e049a-1983-4e88-a7d0-218818419dd2 req-87dbb1e3-8d32-487e-a9b8-f6e8efa53818 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774581 Nov 15 12:40:17.536926 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a313e0d3-b1db-4062-a850-965a3b17cc26 req-75a323ad-0a09-4da1-a5b0-6af2244ca54e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.539770 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a313e0d3-b1db-4062-a850-965a3b17cc26 req-75a323ad-0a09-4da1-a5b0-6af2244ca54e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 931 time: 0.2288973 Nov 15 12:40:17.568251 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['cf81a6f4-3d88-4d0e-b9d2-b79c61aea820'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:17.618986 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-f169df39-634d-4346-a934-93c3d3101d46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.620780 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab0a6ec0-4b54-48bd-ae19-c18b692433d4 req-f169df39-634d-4346-a934-93c3d3101d46 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3072000 Nov 15 12:40:17.680015 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a313e0d3-b1db-4062-a850-965a3b17cc26 req-6429ac06-77b7-4545-8118-d3b67d53ab22 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1183865 Nov 15 12:40:17.688307 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:17.732218 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:17.751691 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:17.793145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Transition to ACTIVE for port object 36928b8a-e800-43e0-9edd-e13ae44ee93e will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:17.800425 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:17.821855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['08424d3d-6d1d-4f23-b097-340c6cd4f857'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:17.844038 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-91ccb97b-51da-4ed9-9432-21905744aac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.845601 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-91ccb97b-51da-4ed9-9432-21905744aac7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1096 time: 0.1043041 Nov 15 12:40:17.870910 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:17.980187 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da2e12a2-b1e8-47b5-adab-9416a71112c4 req-f85a5322-d57c-4631-9ae7-4a6ddfd5220c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:17.988511 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-da2e12a2-b1e8-47b5-adab-9416a71112c4 req-f85a5322-d57c-4631-9ae7-4a6ddfd5220c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.0791380 Nov 15 12:40:17.998772 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-a4c5530b-a1d9-43ce-bea8-2c9f35a8f391 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7 HTTP/1.1" status: 200 len: 217 time: 0.1236596 Nov 15 12:40:18.044431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Attempting to bind port 36928b8a-e800-43e0-9edd-e13ae44ee93e on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:18.044431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Attempting to bind port 36928b8a-e800-43e0-9edd-e13ae44ee93e by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:18.044431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Attempting to bind port 36928b8a-e800-43e0-9edd-e13ae44ee93e on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:18.059773 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-da2e12a2-b1e8-47b5-adab-9416a71112c4 req-69c22f3a-7ac7-42ac-b6df-75a554a0d8ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695066 Nov 15 12:40:18.091522 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Port 36928b8a-e800-43e0-9edd-e13ae44ee93e on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:18.091840 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Attempting to bind port 36928b8a-e800-43e0-9edd-e13ae44ee93e on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:18.105924 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 40, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:18.106310 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Checking segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:18.106697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Bound using segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:18.107135 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Bound port: 36928b8a-e800-43e0-9edd-e13ae44ee93e, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:18.107485 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:18.121406 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406537b0-3747-4956-bdf2-dda6bc971322 req-4453b4c8-ca6e-4954-876f-4a06d7adcda5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:18.123007 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-4453b4c8-ca6e-4954-876f-4a06d7adcda5 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.0821412 Nov 15 12:40:18.203197 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-c446f016-587c-46f6-b573-c68c2704e29b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0552406 Nov 15 12:40:18.307351 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:18.349775 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:18.360805 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:18.423247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ac2854-17c0-4cac-aa40-d2b7a87439f4 req-3b1b9208-c051-4cae-b6f4-474aa22e6367 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:18.425363 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a0ac2854-17c0-4cac-aa40-d2b7a87439f4 req-3b1b9208-c051-4cae-b6f4-474aa22e6367 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.1563406 Nov 15 12:40:18.431612 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:18.432033 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:18.433531 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] 10.222.0.61 "PUT /v2.0/ports/36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 1093 time: 1.5268068 Nov 15 12:40:18.435626 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:18.437961 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5514d9f2-3999-4148-a9c0-eb21020fbb53" -d '{"events": [{"name": "network-changed", "server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:18.456819 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-628191e3-fe88-4419-9915-ed53327bb81a service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2441218 Nov 15 12:40:18.602145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-033d79c4-fa69-401e-82af-4858b6d1d05c x-openstack-request-id: req-033d79c4-fa69-401e-82af-4858b6d1d05c {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:18.602780 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:18.603211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-033d79c4-fa69-401e-82af-4858b6d1d05c {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:18.603815 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'status': 'completed', 'code': 200} Nov 15 12:40:18.604989 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9769db-635f-4ae3-aedf-e17b1ef69ae9 service neutron] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:18.857299 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be1902b5-c6be-467e-9e18-8afbb82d40e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:18.859807 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-be1902b5-c6be-467e-9e18-8afbb82d40e9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1096 time: 0.3090880 Nov 15 12:40:18.889730 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd64bc8-4c6a-4e67-a6fb-1574ddc0e53f req-6d866522-26f8-4972-adcc-a5b8d6dffd41 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:18.891314 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cd64bc8-4c6a-4e67-a6fb-1574ddc0e53f req-6d866522-26f8-4972-adcc-a5b8d6dffd41 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.1462440 Nov 15 12:40:18.895620 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a0ac2854-17c0-4cac-aa40-d2b7a87439f4 req-c8b9b819-41cb-4ec1-9044-a5810bd31628 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4490671 Nov 15 12:40:18.914752 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-406537b0-3747-4956-bdf2-dda6bc971322 req-d26aedd0-dcd4-4c71-8a91-531ed1f5aed9 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4428601 Nov 15 12:40:18.958920 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-0fe35636-a2f1-405d-a731-4546493cac31 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 217 time: 0.0735521 Nov 15 12:40:19.029156 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cd64bc8-4c6a-4e67-a6fb-1574ddc0e53f req-e2e80e22-651d-4474-96f9-15db567e4d68 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1167269 Nov 15 12:40:19.069654 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-b32b18e2-16c2-4ba2-a927-64ec0ca4dc66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:19.072238 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-b32b18e2-16c2-4ba2-a927-64ec0ca4dc66 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0977681 Nov 15 12:40:19.273083 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca5f8dd-7fdf-4aa3-a13c-77676ee694e1 req-21a73c31-dc12-49d4-b46f-e9e7eaffbeb4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:19.274665 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1ca5f8dd-7fdf-4aa3-a13c-77676ee694e1 req-21a73c31-dc12-49d4-b46f-e9e7eaffbeb4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.0801375 Nov 15 12:40:19.362276 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1ca5f8dd-7fdf-4aa3-a13c-77676ee694e1 req-6057c79f-274c-416c-a5f5-e502cb0c01f1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737348 Nov 15 12:40:19.415101 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5d0a09-708d-4b7e-aa83-7f020edc7acc req-978eb9ce-1b8c-4828-ae15-58acdb889c15 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:19.424621 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d5d0a09-708d-4b7e-aa83-7f020edc7acc req-978eb9ce-1b8c-4828-ae15-58acdb889c15 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.3511186 Nov 15 12:40:19.439663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd8422e-d679-4962-8054-83c21cebeaea req-3aeb7ca8-96af-43a8-bdc0-c4863b2d9a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:19.441329 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-3aeb7ca8-96af-43a8-bdc0-c4863b2d9a7b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0871785 Nov 15 12:40:19.545047 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d5d0a09-708d-4b7e-aa83-7f020edc7acc req-689655bd-354c-4ace-ba88-1029349514c5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1192777 Nov 15 12:40:19.594977 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-9efc6469-211d-4251-886e-7918cddaec6d service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1437452 Nov 15 12:40:19.721952 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0bd8422e-d679-4962-8054-83c21cebeaea req-7be60290-960b-4fe9-a0be-ba64eb59f813 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1156964 Nov 15 12:40:19.883435 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-94614797-a748-4285-bf5c-02e32090afac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:19.885046 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-94614797-a748-4285-bf5c-02e32090afac service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1096 time: 0.0496826 Nov 15 12:40:20.086233 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-0668fe38-a14f-421c-8245-5478d8083f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.087856 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-0668fe38-a14f-421c-8245-5478d8083f89 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.1937826 Nov 15 12:40:20.132673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c235ecdd-bacb-4ebc-ad88-d8693ccaa552 req-7d22d65a-480f-4420-a9f8-ee06e267474a tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.147480 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c235ecdd-bacb-4ebc-ad88-d8693ccaa552 req-7d22d65a-480f-4420-a9f8-ee06e267474a tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.1288135 Nov 15 12:40:20.177259 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-77827ce7-8770-42ee-aefe-42457aefc105 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 217 time: 0.0756569 Nov 15 12:40:20.265203 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-676d1036-1956-44e7-b918-c81b083a1e1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.266660 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-676d1036-1956-44e7-b918-c81b083a1e1e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0735493 Nov 15 12:40:20.277345 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c235ecdd-bacb-4ebc-ad88-d8693ccaa552 req-05a6da1a-f823-42e4-aa55-aa209ac8b9e3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285691 Nov 15 12:40:20.282428 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf071355-2c47-4394-8541-548bae76f2ce req-0205f224-d8c2-4e10-9684-c99bcaf5992c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.300992 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bf071355-2c47-4394-8541-548bae76f2ce req-0205f224-d8c2-4e10-9684-c99bcaf5992c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.1353195 Nov 15 12:40:20.346268 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47932) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:20.416339 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-b7153164-bf66-4dcf-8aa7-d19dd2a01087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.418128 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-b7153164-bf66-4dcf-8aa7-d19dd2a01087 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1141541 Nov 15 12:40:20.430058 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bf071355-2c47-4394-8541-548bae76f2ce req-45238e96-d2b9-4dee-9576-a4a642136e14 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259239 Nov 15 12:40:20.522406 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9d06f74-66bb-463d-800c-36b7e82e9218 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:20.568582 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-1c0e9d50-b040-45b6-b1c3-212d6602311e service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1344833 Nov 15 12:40:20.704452 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9d06f74-66bb-463d-800c-36b7e82e9218 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:20.720558 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9d06f74-66bb-463d-800c-36b7e82e9218 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:20.734593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd61f823-2cdc-4296-9366-c863a7fecf31 req-657529bb-bf90-4bd2-b933-c3862253881e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.743790 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bd61f823-2cdc-4296-9366-c863a7fecf31 req-657529bb-bf90-4bd2-b933-c3862253881e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 943 time: 0.2271855 Nov 15 12:40:20.807549 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a9d06f74-66bb-463d-800c-36b7e82e9218 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=768248766fd6467699e184b3b586fa4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4593878 Nov 15 12:40:20.809866 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47954) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:20.831489 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b023888c-0b60-41ce-b905-5c4aa3840efd req-f130b690-f375-4ddc-8474-cb0e027b78a3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:20.833924 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b023888c-0b60-41ce-b905-5c4aa3840efd req-f130b690-f375-4ddc-8474-cb0e027b78a3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1311703 Nov 15 12:40:20.840278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5514d9f2-3999-4148-a9c0-eb21020fbb53 req-842397ec-df0f-40af-9f3b-2935651e4a52 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2590933 Nov 15 12:40:20.854661 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d06f74-66bb-463d-800c-36b7e82e9218 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49dfee3f-a562-4dfc-b4fe-d7680e92c66a,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:20.896751 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bd61f823-2cdc-4296-9366-c863a7fecf31 req-9a462e46-8699-4295-8bea-d271630f0fbb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1518629 Nov 15 12:40:20.904643 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:20.911788 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b023888c-0b60-41ce-b905-5c4aa3840efd req-b213b59e-baf0-47ff-a13c-4841a2153cd4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0694144 Nov 15 12:40:20.951946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:20.976402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device b9ecf6e8-fd12-4b4f-9471-efed756013e7 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:20.987569 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 1bf5cf4f-25e6-407d-8d56-f33732c6f670 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:21.032795 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.038610 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.040499 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/49dfee3f-a562-4dfc-b4fe-d7680e92c66a HTTP/1.1" status: 204 len: 168 time: 0.2264488 Nov 15 12:40:21.053853 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66b156b-c6d2-4ecd-9a6c-02dca56699a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49dfee3f-a562-4dfc-b4fe-d7680e92c66a,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:21.161715 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:21.177725 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:21.178238 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.276023 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:21.305373 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7', 'network_id': '4a1ca915-de15-4ccc-96e8-10f04d0723e3', 'port_id': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7', 'mac_address': 'fa:16:3e:7f:64:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 641, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ac24af71-ce9d-47b2-a800-8b7fc2391e39', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:21.400596 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28523f5-40d5-4248-aea3-e9d6270c8779 req-6f3241c4-bdf5-4026-8a30-5f0adbc1680d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:21.402930 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f28523f5-40d5-4248-aea3-e9d6270c8779 req-6f3241c4-bdf5-4026-8a30-5f0adbc1680d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.0621095 Nov 15 12:40:21.478381 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f28523f5-40d5-4248-aea3-e9d6270c8779 req-c0c66cb6-3a34-4af2-834b-0f6701c95074 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674932 Nov 15 12:40:21.497885 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.526275 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.531199 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 47972) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:21.542327 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:21.548464 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dc7d206e-7cf6-4214-a835-5fa291bbbc3f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.580173 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f85ed35-48f7-440e-bbc8-78a0edcef366 req-da430c89-c253-4f61-a06d-be8984730939 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:21.581992 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5f85ed35-48f7-440e-bbc8-78a0edcef366 req-da430c89-c253-4f61-a06d-be8984730939 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 945 time: 0.0667083 Nov 15 12:40:21.630525 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:21.632954 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b9ecf6e8-fd12-4b4f-9471-efed756013e7 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:21.639105 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.639938 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 08424d3d-6d1d-4f23-b097-340c6cd4f857 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:21.653473 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5f85ed35-48f7-440e-bbc8-78a0edcef366 req-6a6476d0-0569-448d-a1fa-2f4a3df708c7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599716 Nov 15 12:40:21.659879 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dc7d206e-7cf6-4214-a835-5fa291bbbc3f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.668442 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dc7d206e-7cf6-4214-a835-5fa291bbbc3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.709184 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7d206e-7cf6-4214-a835-5fa291bbbc3f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba51faa6-bd1e-4cb2-a114-042e6a802589,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:21.731624 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:21.742508 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.744617 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 47982) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:21.745143 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:21.745261 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dc7d206e-7cf6-4214-a835-5fa291bbbc3f admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=89ab9f3ecb7642e09d84ad120b657949&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2128708 Nov 15 12:40:21.787915 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:21.857987 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 08424d3d-6d1d-4f23-b097-340c6cd4f857 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:21.865702 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.866847 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d6b4ad5-6a0c-412e-af87-ced7e8323c85" -d '{"events": [{"server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "name": "network-vif-plugged", "status": "completed", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:21.885551 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 08424d3d-6d1d-4f23-b097-340c6cd4f857 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:21.886366 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.900392 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.938992 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:21.985595 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:21.987704 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.991303 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:21.995389 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/ba51faa6-bd1e-4cb2-a114-042e6a802589 HTTP/1.1" status: 204 len: 168 time: 0.2450693 Nov 15 12:40:22.007236 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:22.023107 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528cb828-1274-4c88-8cb8-e9b16353dc63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba51faa6-bd1e-4cb2-a114-042e6a802589,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:22.095250 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2afcef3-3c20-4ec4-8ce5-7eafcf0b305f x-openstack-request-id: req-f2afcef3-3c20-4ec4-8ce5-7eafcf0b305f {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:22.095640 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "name": "network-vif-plugged", "status": "completed", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:22.096705 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-f2afcef3-3c20-4ec4-8ce5-7eafcf0b305f {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:22.097312 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670', 'code': 200} Nov 15 12:40:22.122672 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.136275 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.153322 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:22.190923 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48413df1-c4cc-4cfb-b04f-25ef9b64d605 req-2503247d-d08c-4915-87e6-09a3ee5e31e8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:22.193869 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-48413df1-c4cc-4cfb-b04f-25ef9b64d605 req-2503247d-d08c-4915-87e6-09a3ee5e31e8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.1592002 Nov 15 12:40:22.264099 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:22.280687 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:22.285185 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.299376 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61aa90d0-3965-470b-a65c-a55e32f407c0 req-5cc7e394-03f9-4216-bcde-354c9dc3d500 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:22.312525 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61aa90d0-3965-470b-a65c-a55e32f407c0 req-5cc7e394-03f9-4216-bcde-354c9dc3d500 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1345291 Nov 15 12:40:22.356093 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.357017 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:22.372648 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-48413df1-c4cc-4cfb-b04f-25ef9b64d605 req-67282aad-cc47-4a52-b2e3-a1a23db1245f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1720107 Nov 15 12:40:22.429227 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61aa90d0-3965-470b-a65c-a55e32f407c0 req-da72df5e-88d4-4ee9-b7c6-833dcda9cc6f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1147239 Nov 15 12:40:22.459900 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:22.561293 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:22.573333 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-fb7a55b0-5eef-49df-9b1d-0d118e4183f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:22.576137 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-fb7a55b0-5eef-49df-9b1d-0d118e4183f3 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 1099 time: 0.2002015 Nov 15 12:40:22.585572 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:22.586767 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.651814 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-1b3dad31-81e6-4196-870c-418501f28908 service neutron] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.697763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:22.713158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88449fad-e25d-44a2-9144-a82696804f24 req-bbac2705-3036-4dad-9257-1928b6d8ff2c tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:22.722006 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-88449fad-e25d-44a2-9144-a82696804f24 req-bbac2705-3036-4dad-9257-1928b6d8ff2c tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 945 time: 0.1299067 Nov 15 12:40:22.845862 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['b9ecf6e8-fd12-4b4f-9471-efed756013e7'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:22.863431 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-88449fad-e25d-44a2-9144-a82696804f24 req-ea39b4de-4352-4164-91cb-df6c6ca36b75 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1230154 Nov 15 12:40:22.864943 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48028) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:22.880202 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4836a23-e25c-4e2a-bbb8-835544a83ed3 req-0fb2727b-e603-461a-ba39-d5bd372f8939 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:22.900248 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['36928b8a-e800-43e0-9edd-e13ae44ee93e'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:22.903081 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-1b3dad31-81e6-4196-870c-418501f28908 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.903892 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f4836a23-e25c-4e2a-bbb8-835544a83ed3 req-0fb2727b-e603-461a-ba39-d5bd372f8939 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1384957 Nov 15 12:40:22.914151 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-1b3dad31-81e6-4196-870c-418501f28908 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:22.979538 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f4836a23-e25c-4e2a-bbb8-835544a83ed3 req-f0b53524-5fe8-4904-8fe9-c21b4672f8c4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739989 Nov 15 12:40:22.998294 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.006244 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3dad31-81e6-4196-870c-418501f28908 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b0c5108e-467d-4dd8-8000-15f629e178fd,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:23.011800 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e705a81-1fce-409c-9f4d-63f86a9de5e5 req-1b3dad31-81e6-4196-870c-418501f28908 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4222624 Nov 15 12:40:23.106796 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,segment=NetworkSegment(42712e6e-6181-4ceb-bdda-98824d122256),segment_id=42712e6e-6181-4ceb-bdda-98824d122256)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:23.108379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0c042a7b-de38-4b36-9c98-6ecd2a7888cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.115277 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.238559 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:23.258827 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0c042a7b-de38-4b36-9c98-6ecd2a7888cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.264311 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0c042a7b-de38-4b36-9c98-6ecd2a7888cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.306432 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-0c042a7b-de38-4b36-9c98-6ecd2a7888cd admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=0cde98cde8884e048aa92cc2d06f4043&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4367175 Nov 15 12:40:23.307334 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c042a7b-de38-4b36-9c98-6ecd2a7888cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7efa0626-a557-4dc0-a7e3-ebaa2d751b35,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:23.310081 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48040) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:23.374651 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.398059 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.454292 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.458346 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:23.461933 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7efa0626-a557-4dc0-a7e3-ebaa2d751b35 HTTP/1.1" status: 204 len: 168 time: 0.1480010 Nov 15 12:40:23.468793 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ecd408-9b72-4602-b781-95a9733b9f22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7efa0626-a557-4dc0-a7e3-ebaa2d751b35,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:23.576441 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7828d77-df26-41d7-ad79-8c1022991c75 req-a323688e-c783-4272-b8d3-f0978294e6e6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:23.588351 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c7828d77-df26-41d7-ad79-8c1022991c75 req-a323688e-c783-4272-b8d3-f0978294e6e6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.0877099 Nov 15 12:40:23.637206 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87585e3-a4aa-41b0-b616-aa05e5665f2e req-ccd4aab3-7584-47de-8fff-792c394dfaa6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:23.639104 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c87585e3-a4aa-41b0-b616-aa05e5665f2e req-ccd4aab3-7584-47de-8fff-792c394dfaa6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0736213 Nov 15 12:40:23.656887 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c7828d77-df26-41d7-ad79-8c1022991c75 req-79170425-9a59-4475-aff7-0be72587e879 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677085 Nov 15 12:40:23.721686 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c87585e3-a4aa-41b0-b616-aa05e5665f2e req-876f18f9-ec41-4cde-bab5-ff3a6fea4758 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0740368 Nov 15 12:40:23.971902 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48088) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:23.992963 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-baf2592f-c4f0-4f63-9fd0-220c2d32acad admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.008421 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df02613-c890-4e57-b0ae-f76452ac056d req-a952a27e-2d65-419d-b178-9f2f5560127a tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:24.010152 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0df02613-c890-4e57-b0ae-f76452ac056d req-a952a27e-2d65-419d-b178-9f2f5560127a tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.0577176 Nov 15 12:40:24.098211 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857'}, {'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:24.101537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba4d7caf-d63e-4171-8248-00b6374b1b2d" -d '{"events": [{"server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "name": "network-vif-plugged", "status": "completed", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857"}, {"server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "name": "network-vif-plugged", "status": "completed", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:24.116153 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0df02613-c890-4e57-b0ae-f76452ac056d req-736720b3-1237-4643-86ef-eb97cd5e9322 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870032 Nov 15 12:40:24.150655 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-baf2592f-c4f0-4f63-9fd0-220c2d32acad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.159569 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-baf2592f-c4f0-4f63-9fd0-220c2d32acad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.178667 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6de2fa74-b2f1-4fad-9d46-33cfa63b04a9 x-openstack-request-id: req-6de2fa74-b2f1-4fad-9d46-33cfa63b04a9 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:24.179117 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "name": "network-vif-plugged", "status": "completed", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857", "code": 200}, {"server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "name": "network-vif-plugged", "status": "completed", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:24.179719 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6de2fa74-b2f1-4fad-9d46-33cfa63b04a9 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:24.180337 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857', 'code': 200} Nov 15 12:40:24.180879 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820', 'code': 200} Nov 15 12:40:24.196038 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8a2939-ddda-41f8-9403-90b08335bfe7 req-1a9d7267-f611-4e16-8f3c-2c968fbc117c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:24.197622 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca8a2939-ddda-41f8-9403-90b08335bfe7 req-1a9d7267-f611-4e16-8f3c-2c968fbc117c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1162546 Nov 15 12:40:24.216204 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-baf2592f-c4f0-4f63-9fd0-220c2d32acad admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=967e57583f8c44c3b51b52f9d7ba5874&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2421157 Nov 15 12:40:24.219721 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48128) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:24.222363 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf2592f-c4f0-4f63-9fd0-220c2d32acad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=968d2b5a-5db3-456c-bc60-aa17e281a0ce,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:24.271307 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca8a2939-ddda-41f8-9403-90b08335bfe7 req-2226e705-5f07-41f6-a782-e39548b4f85d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541749 Nov 15 12:40:24.313849 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.363469 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.420334 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.422840 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:24.424053 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/968d2b5a-5db3-456c-bc60-aa17e281a0ce HTTP/1.1" status: 204 len: 168 time: 0.2026653 Nov 15 12:40:24.432752 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194cc5d1-344d-4e78-8e1a-9f5ffce99959 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=968d2b5a-5db3-456c-bc60-aa17e281a0ce,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:24.793284 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b504ccd4-9ade-4031-b103-eccfa603b4fb req-17887c34-142d-418a-8251-40178087496a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:24.794982 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b504ccd4-9ade-4031-b103-eccfa603b4fb req-17887c34-142d-418a-8251-40178087496a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.0629251 Nov 15 12:40:24.860523 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b504ccd4-9ade-4031-b103-eccfa603b4fb req-c84e50e3-05ac-40b9-83d9-b5320de05dae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560575 Nov 15 12:40:24.860727 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec79e6d-6f04-4708-8433-22c494c98cfb req-64ec8adf-8580-40fd-a22b-732f70d167ca tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:24.862255 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bec79e6d-6f04-4708-8433-22c494c98cfb req-64ec8adf-8580-40fd-a22b-732f70d167ca tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0619776 Nov 15 12:40:24.927610 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bec79e6d-6f04-4708-8433-22c494c98cfb req-128249a9-8319-4e07-adfd-c5577b730bed tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0555794 Nov 15 12:40:25.277911 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf525124-0c35-42d8-a1a5-70845116fb4c req-590ac3cc-622b-4f77-b97a-dd3d57c15cf1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:25.280552 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cf525124-0c35-42d8-a1a5-70845116fb4c req-590ac3cc-622b-4f77-b97a-dd3d57c15cf1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.0679684 Nov 15 12:40:25.348609 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cf525124-0c35-42d8-a1a5-70845116fb4c req-8e460b09-e23e-479b-9ee9-570578380ef3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602939 Nov 15 12:40:25.414745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9227715d-5595-4add-a096-e5d8f1ee9349 req-e3421cd1-f725-4aaf-ab2e-c4eb10c598a4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:25.416337 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9227715d-5595-4add-a096-e5d8f1ee9349 req-e3421cd1-f725-4aaf-ab2e-c4eb10c598a4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.0665588 Nov 15 12:40:25.465963 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9227715d-5595-4add-a096-e5d8f1ee9349 req-61773bf6-871b-4537-9399-4796d4d91239 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434513 Nov 15 12:40:26.004877 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35981a1d-55b9-4d8d-9931-1307cea26750 req-9a97d084-c4a1-40cf-ad68-a4548323e277 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.006401 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35981a1d-55b9-4d8d-9931-1307cea26750 req-9a97d084-c4a1-40cf-ad68-a4548323e277 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.0602682 Nov 15 12:40:26.059833 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a3048d-66c9-4dc8-9b58-2cb73163106b req-55c0559c-279a-4ee7-853e-1e5307529dae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.061604 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8a3048d-66c9-4dc8-9b58-2cb73163106b req-55c0559c-279a-4ee7-853e-1e5307529dae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0554988 Nov 15 12:40:26.064670 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35981a1d-55b9-4d8d-9931-1307cea26750 req-f5bfb927-9abb-40c3-a6b3-cb826717b77b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507839 Nov 15 12:40:26.122106 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8a3048d-66c9-4dc8-9b58-2cb73163106b req-47c515c9-ea27-42d3-a866-f299c6a0e7ad tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521781 Nov 15 12:40:26.588141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89d7a89-8be2-4ee9-a356-3aa07543b0b5 req-7160f924-d9c3-43d1-9951-4f5169d0b99d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.595099 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a89d7a89-8be2-4ee9-a356-3aa07543b0b5 req-7160f924-d9c3-43d1-9951-4f5169d0b99d tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1183181 Nov 15 12:40:26.729360 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63b8934-59f6-45c8-a083-ce884067e4e1 req-515e89e8-0970-4eee-bb62-0f437356a2c2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.732506 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e63b8934-59f6-45c8-a083-ce884067e4e1 req-515e89e8-0970-4eee-bb62-0f437356a2c2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1191576 Nov 15 12:40:26.786176 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a89d7a89-8be2-4ee9-a356-3aa07543b0b5 req-a718908b-b370-422c-bbe2-4e3bb2ce5fba tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484506 Nov 15 12:40:26.800079 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace15c38-e8fe-411c-a3fc-58380652ec7a req-65fae0be-e417-4f99-b77b-046e59d286e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.810622 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ace15c38-e8fe-411c-a3fc-58380652ec7a req-65fae0be-e417-4f99-b77b-046e59d286e6 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 1099 time: 0.2053254 Nov 15 12:40:26.830429 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15f30128-31ae-4672-9891-7e04c0587253 req-83fb3e31-d058-42ef-98be-00238f054d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:26.830962 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e63b8934-59f6-45c8-a083-ce884067e4e1 req-f2f496d5-dc88-4aa2-ba17-cc7a7fc346b4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879040 Nov 15 12:40:26.831994 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-15f30128-31ae-4672-9891-7e04c0587253 req-83fb3e31-d058-42ef-98be-00238f054d84 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.1916070 Nov 15 12:40:26.930022 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ace15c38-e8fe-411c-a3fc-58380652ec7a req-f4490341-581b-49bc-bebd-6ce6d60c7c21 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137395 Nov 15 12:40:26.956038 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-15f30128-31ae-4672-9891-7e04c0587253 req-d53ca6cc-a515-483c-b1e2-f6a087efa769 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1059570 Nov 15 12:40:27.213659 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89cd2aa-50f1-42cc-b3c8-f246b4bc0219 req-b472dbeb-0aee-4cd0-8dd2-5228bcde939b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:27.223219 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d89cd2aa-50f1-42cc-b3c8-f246b4bc0219 req-b472dbeb-0aee-4cd0-8dd2-5228bcde939b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.0751278 Nov 15 12:40:27.308573 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d89cd2aa-50f1-42cc-b3c8-f246b4bc0219 req-effae49a-eaa1-4654-969b-55bf597de74b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825059 Nov 15 12:40:27.418673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f3025b-8879-4ca2-a8ea-90477a03f7c1 req-daf32ed2-ccc0-4a5e-ba63-2ab52d29c84d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:27.421620 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4f3025b-8879-4ca2-a8ea-90477a03f7c1 req-daf32ed2-ccc0-4a5e-ba63-2ab52d29c84d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0995133 Nov 15 12:40:27.514662 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4f3025b-8879-4ca2-a8ea-90477a03f7c1 req-0da739e3-44b2-4f6b-9f12-982baba311be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0804210 Nov 15 12:40:27.664325 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48280) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:27.886118 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-284ac72b-d6a6-436a-9bcc-c6c4aefe6404 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.015398 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabe1834-d005-43b6-beff-cd038a4b4a43 req-4fc60fec-a18f-4744-b591-644c18082de4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:28.017323 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aabe1834-d005-43b6-beff-cd038a4b4a43 req-4fc60fec-a18f-4744-b591-644c18082de4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.0711529 Nov 15 12:40:28.032181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15857f6-a1e8-4b0e-a6bb-a541b29945f0 req-93c40562-469d-40ce-9f04-cd3cd570ce6e tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:28.038551 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a15857f6-a1e8-4b0e-a6bb-a541b29945f0 req-93c40562-469d-40ce-9f04-cd3cd570ce6e tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1352067 Nov 15 12:40:28.136766 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-284ac72b-d6a6-436a-9bcc-c6c4aefe6404 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.147419 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a15857f6-a1e8-4b0e-a6bb-a541b29945f0 req-ab9f5706-e827-4e48-8b49-73b029db2b92 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065536 Nov 15 12:40:28.149647 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-284ac72b-d6a6-436a-9bcc-c6c4aefe6404 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.170705 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aabe1834-d005-43b6-beff-cd038a4b4a43 req-33afc67e-0aa2-4fef-b025-64ef1e375ba5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223652 Nov 15 12:40:28.230926 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-284ac72b-d6a6-436a-9bcc-c6c4aefe6404 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=91c2c3b76f034eb4a70457c34ba1d849&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5650904 Nov 15 12:40:28.234922 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48296) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:28.251422 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284ac72b-d6a6-436a-9bcc-c6c4aefe6404 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f1de382-4997-472d-81b9-7589f8a20193,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:28.289455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device b9ecf6e8-fd12-4b4f-9471-efed756013e7 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:28.384928 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.388081 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port b9ecf6e8-fd12-4b4f-9471-efed756013e7 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:28.400579 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port b9ecf6e8-fd12-4b4f-9471-efed756013e7 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:28.401756 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.434970 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.519208 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.529819 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f31293-8333-4c1e-bcdd-9d21acecdfd4 req-6442fcf3-9b3d-4670-9447-f8de33c80a0c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:28.532508 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-95f31293-8333-4c1e-bcdd-9d21acecdfd4 req-6442fcf3-9b3d-4670-9447-f8de33c80a0c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 944 time: 0.0706446 Nov 15 12:40:28.542205 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.547610 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.547918 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:28.550529 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-638d9791-25e8-496b-bfc0-f2d12fe1a6d7" -d '{"events": [{"server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "name": "network-vif-plugged", "status": "completed", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:28.550776 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/9f1de382-4997-472d-81b9-7589f8a20193 HTTP/1.1" status: 204 len: 168 time: 0.3129661 Nov 15 12:40:28.569520 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:28.573333 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11fba2d4-8adb-4a1b-b2ea-aed42daa8314 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f1de382-4997-472d-81b9-7589f8a20193,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:28.575855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.577313 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:28.638829 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-95f31293-8333-4c1e-bcdd-9d21acecdfd4 req-24a94ced-c95e-4348-80bf-5047d2fe3f85 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0916917 Nov 15 12:40:28.645568 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d8b3b92-95ae-4ce2-bad7-651a851c3992 x-openstack-request-id: req-6d8b3b92-95ae-4ce2-bad7-651a851c3992 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:28.645940 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "name": "network-vif-plugged", "status": "completed", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:28.646120 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6d8b3b92-95ae-4ce2-bad7-651a851c3992 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:28.646691 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7', 'code': 200} Nov 15 12:40:28.712408 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:28.737897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 36928b8a-e800-43e0-9edd-e13ae44ee93e completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:28.746917 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 36928b8a-e800-43e0-9edd-e13ae44ee93e triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:28.747447 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:28.828053 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33288028-39a5-4e5e-ba02-7eaec5e431a2 req-f94bc105-1483-4724-ad3e-4c915ea6e2ec tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:28.841718 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-33288028-39a5-4e5e-ba02-7eaec5e431a2 req-f94bc105-1483-4724-ad3e-4c915ea6e2ec tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.1103811 Nov 15 12:40:28.909664 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-33288028-39a5-4e5e-ba02-7eaec5e431a2 req-69ae8058-84aa-41ea-9e63-75e247b42217 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632014 Nov 15 12:40:29.048625 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.138376 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48322) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:29.139818 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:29.148702 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.171999 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e8a86aed-f71f-43e4-8f2b-4d0fd5437aae admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.201061 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36a3bd1-69a5-4582-832c-0a1539d03c02 req-f39d9c0b-94c8-4a6a-b73e-7363496e216b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:29.204362 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d36a3bd1-69a5-4582-832c-0a1539d03c02 req-f39d9c0b-94c8-4a6a-b73e-7363496e216b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1098 time: 0.1714435 Nov 15 12:40:29.336226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:29.346368 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d36a3bd1-69a5-4582-832c-0a1539d03c02 req-e464ab9b-4975-4eb1-9a85-6f726622219a service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326132 Nov 15 12:40:29.427274 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca3379a-cc6e-4a8e-84d2-6895f1595760 req-7dbd503d-a2a5-4484-b6ed-e64791d6137b tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:29.437547 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aca3379a-cc6e-4a8e-84d2-6895f1595760 req-7dbd503d-a2a5-4484-b6ed-e64791d6137b tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.0898294 Nov 15 12:40:29.488391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e8a86aed-f71f-43e4-8f2b-4d0fd5437aae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.496095 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aca3379a-cc6e-4a8e-84d2-6895f1595760 req-a6429ab1-595d-47fb-bee9-fe41e3c1f7e8 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574458 Nov 15 12:40:29.498270 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e8a86aed-f71f-43e4-8f2b-4d0fd5437aae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.580950 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f0972d-8f14-4105-b332-4546570a4c3b req-76191933-26df-42a2-84ed-e103bde27e56 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:29.582851 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-62f0972d-8f14-4105-b332-4546570a4c3b req-76191933-26df-42a2-84ed-e103bde27e56 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.2122860 Nov 15 12:40:29.591576 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e8a86aed-f71f-43e4-8f2b-4d0fd5437aae admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=da4f0253b4d94a2eacc90315efcfd74e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4510148 Nov 15 12:40:29.593387 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48342) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:29.599676 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a86aed-f71f-43e4-8f2b-4d0fd5437aae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef3823b1-52cb-4142-9a4d-10ad3af5ea06,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:29.646739 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-62f0972d-8f14-4105-b332-4546570a4c3b req-9ba2802e-1d7a-492b-a827-a30bcf85903e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534341 Nov 15 12:40:29.680851 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.746964 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.882515 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eab85b6-58d3-4311-9e40-7588e2dd4e8e req-99c8453b-c0a0-4651-821a-6e5422eb0571 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:29.884233 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6eab85b6-58d3-4311-9e40-7588e2dd4e8e req-99c8453b-c0a0-4651-821a-6e5422eb0571 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1213691 Nov 15 12:40:29.919990 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.924540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:29.931049 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/ef3823b1-52cb-4142-9a4d-10ad3af5ea06 HTTP/1.1" status: 204 len: 168 time: 0.3354142 Nov 15 12:40:29.963633 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c29bc5-5356-4da0-ad75-50b25dc155ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef3823b1-52cb-4142-9a4d-10ad3af5ea06,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:30.029178 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6eab85b6-58d3-4311-9e40-7588e2dd4e8e req-e637ed64-99eb-495e-8103-c6c3103deada tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1372137 Nov 15 12:40:30.215222 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb089327-01a0-4b07-8e50-dc9ff644f8b5 req-555d1334-c8ab-4822-95f6-17c3fa56bee6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:30.217671 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb089327-01a0-4b07-8e50-dc9ff644f8b5 req-555d1334-c8ab-4822-95f6-17c3fa56bee6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1002727 Nov 15 12:40:30.309535 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb089327-01a0-4b07-8e50-dc9ff644f8b5 req-2c7965eb-65e4-463c-875b-df647d8d99b2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0812283 Nov 15 12:40:30.599670 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48364) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:30.621621 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4d6d02d7-7f29-4b11-8153-c64b0367b6c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:30.648809 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:30.656506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11d842c5-7661-48b4-87a2-46048c2acb4e" -d '{"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:30.675889 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c233b8-5ac4-46c8-9a2b-53d820b76515 req-ebf7611f-4984-4ce4-9725-c0ff4c450de0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:30.678712 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77c233b8-5ac4-46c8-9a2b-53d820b76515 req-ebf7611f-4984-4ce4-9725-c0ff4c450de0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.0854461 Nov 15 12:40:30.730378 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01831ec2-de99-47b6-b407-605f35d08274 x-openstack-request-id: req-01831ec2-de99-47b6-b407-605f35d08274 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:30.730750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:30.731052 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-01831ec2-de99-47b6-b407-605f35d08274 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:30.731499 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'code': 200} Nov 15 12:40:30.754746 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4d6d02d7-7f29-4b11-8153-c64b0367b6c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:30.760034 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4d6d02d7-7f29-4b11-8153-c64b0367b6c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:30.768831 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-77c233b8-5ac4-46c8-9a2b-53d820b76515 req-2f53f796-e0cf-4f03-b685-9d1c96207a61 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728815 Nov 15 12:40:30.825330 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4d6d02d7-7f29-4b11-8153-c64b0367b6c1 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=50aed6dd0b4f4f438ec3fa5c42a909b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2241931 Nov 15 12:40:30.826604 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6d02d7-7f29-4b11-8153-c64b0367b6c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bb4a028-81d5-4f0b-a43b-ad6edb72731a,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:30.828427 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48376) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:30.983695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:31.018919 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:31.100942 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:31.118408 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:31.125104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/0bb4a028-81d5-4f0b-a43b-ad6edb72731a HTTP/1.1" status: 204 len: 168 time: 0.2904832 Nov 15 12:40:31.160367 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd477c7e-783f-4f2e-9cd7-7d6bf24a6de4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bb4a028-81d5-4f0b-a43b-ad6edb72731a,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:31.299512 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe846e4-9981-4586-9f8d-43f11c1b3b8c req-aebb1d03-8f25-4d5e-9982-4faab8027cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:31.303353 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1fe846e4-9981-4586-9f8d-43f11c1b3b8c req-aebb1d03-8f25-4d5e-9982-4faab8027cff service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1098 time: 0.1449285 Nov 15 12:40:31.309986 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d4099c-6323-4cb3-bdfb-48beda37135f req-d49ac9da-666f-4493-9ef7-9c6a228beff5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:31.318165 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-57d4099c-6323-4cb3-bdfb-48beda37135f req-d49ac9da-666f-4493-9ef7-9c6a228beff5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0856848 Nov 15 12:40:31.392874 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-57d4099c-6323-4cb3-bdfb-48beda37135f req-bbde6007-e7cd-4584-acc5-14b88e4bf947 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665345 Nov 15 12:40:31.555270 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1fe846e4-9981-4586-9f8d-43f11c1b3b8c req-3134be33-dee3-4909-952b-911475ad7c2c service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2373929 Nov 15 12:40:31.586547 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e62d3d-f33c-4989-b669-631ea5f2be26 req-d4ba2f61-dbc5-4176-835c-6bfa4543c660 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:31.589775 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-85e62d3d-f33c-4989-b669-631ea5f2be26 req-d4ba2f61-dbc5-4176-835c-6bfa4543c660 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1009555 Nov 15 12:40:31.696592 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-85e62d3d-f33c-4989-b669-631ea5f2be26 req-dd439276-b483-4d55-b7c5-767293e0525f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0909841 Nov 15 12:40:32.701058 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab04fb94-5134-483a-9dac-e506f5b0f35f req-842afdbf-4237-4eac-8be5-d1fe050aaa6f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:32.704499 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab04fb94-5134-483a-9dac-e506f5b0f35f req-842afdbf-4237-4eac-8be5-d1fe050aaa6f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1828434 Nov 15 12:40:32.944438 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab04fb94-5134-483a-9dac-e506f5b0f35f req-2c643116-01fc-44d2-ac19-4ff56d19d3ff tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1795380 Nov 15 12:40:33.018263 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48480) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:33.034351 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be8987c1-b4de-4c94-9748-f62d3093d7ec req-d76b1e59-37fd-42c9-9e92-435c94c67f81 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:33.045996 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-be8987c1-b4de-4c94-9748-f62d3093d7ec req-d76b1e59-37fd-42c9-9e92-435c94c67f81 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1955218 Nov 15 12:40:33.157520 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-be8987c1-b4de-4c94-9748-f62d3093d7ec req-f236bccc-68e7-49f5-813e-296eb09762f0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1096590 Nov 15 12:40:33.307253 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.343642 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-21e6ef78-618c-45c3-adfa-c863d60e7906 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.449582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.455133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.528427 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b2621c6f004c47a09bf6ae65082dfc65&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5084984 Nov 15 12:40:33.532435 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48492) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:33.542212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c5ea508-86d4-4459-88b8-90ca3631b50d,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:33.556562 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.557154 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.557665 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.558149 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.558661 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.558992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.559311 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.559786 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.560294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.560788 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.561264 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.561753 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e762cab2-6362-4d55-9898-9d1c2ef321fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:33.712542 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.751316 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:33.761049 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e0cc93-0389-4287-b210-c6ded6fd65c8 req-f1cf57bf-f76a-4ecc-a364-c99c997929c2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:33.762553 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-57e0cc93-0389-4287-b210-c6ded6fd65c8 req-f1cf57bf-f76a-4ecc-a364-c99c997929c2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1562669 Nov 15 12:40:33.813436 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-7534cb2f-30a1-4eeb-bb09-fe413329bad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:33.815209 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-7534cb2f-30a1-4eeb-bb09-fe413329bad7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1098 time: 0.1589229 Nov 15 12:40:34.199460 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-57e0cc93-0389-4287-b210-c6ded6fd65c8 req-574d8c69-be24-489c-97ed-16665ae67a1c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4188101 Nov 15 12:40:34.240162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:34.240162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:34.240162 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/3c5ea508-86d4-4459-88b8-90ca3631b50d HTTP/1.1" status: 204 len: 168 time: 0.7022524 Nov 15 12:40:34.277327 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75b48902-38ea-487c-9bea-ff004b0852fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c5ea508-86d4-4459-88b8-90ca3631b50d,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:34.305299 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-076fdc79-cca3-4c4e-bd56-90d21f87ccde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:34.307744 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-076fdc79-cca3-4c4e-bd56-90d21f87ccde service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.2229004 Nov 15 12:40:34.408369 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-6bda410d-bcb1-4e19-b816-4d7603cde23e service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7 HTTP/1.1" status: 200 len: 217 time: 0.0903149 Nov 15 12:40:34.503520 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f554a08c-30ce-4969-b3aa-4dde65f6ca55 req-4a14c4ab-27d3-4f42-bcc4-46995bb688a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:34.505793 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f554a08c-30ce-4969-b3aa-4dde65f6ca55 req-4a14c4ab-27d3-4f42-bcc4-46995bb688a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.0957122 Nov 15 12:40:34.556316 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-a03d2f7b-2078-42ce-928d-a909cd6c8dc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:34.557891 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-a03d2f7b-2078-42ce-928d-a909cd6c8dc5 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.1311252 Nov 15 12:40:34.603034 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-73941382-bcd3-463b-af6f-2ad136fd967b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0322897 Nov 15 12:40:34.618333 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f554a08c-30ce-4969-b3aa-4dde65f6ca55 req-8975fab0-f6c8-40f4-80c7-24bc4e6337df tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0992553 Nov 15 12:40:34.759206 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48512) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:34.785324 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-a0940bd9-83f0-4daf-a26e-0f42b3b4a714 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1632714 Nov 15 12:40:34.787392 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:34.995026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47dc14b0-ccbe-44ae-b0bd-876b002df2ca req-5a391f32-aebf-45da-a919-7c8675da8513 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:35.000917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.012717 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.012993 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-47dc14b0-ccbe-44ae-b0bd-876b002df2ca req-5a391f32-aebf-45da-a919-7c8675da8513 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2118261 Nov 15 12:40:35.019268 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48516) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:35.070349 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'floatingip': {'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:35.103483 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc11dbd3-241f-4fe3-8d9d-e4e7065340fd req-d3e2210b-423a-4add-9277-c46a95e3ee38 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2847102 Nov 15 12:40:35.230095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1e085a1-0e6b-4ddf-8334-3548d33a3fd0,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:35.237427 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.275952 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.276539 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.277855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.279677 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.280592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.281786 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.282794 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.284147 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.286398 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.287221 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.287994 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.289428 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:35.419009 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-716c8242-e80a-4d94-9007-9a1d618c6487 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=c35f15998a074aaf8af1d85e68c5d4d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6567819 Nov 15 12:40:35.421326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48540) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:35.508791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1e86c3-cbb2-41cc-9431-7d9925c75c68 req-80ae0fed-f57c-4fa3-9d8e-65b34d70efdb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:35.510869 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb1e86c3-cbb2-41cc-9431-7d9925c75c68 req-80ae0fed-f57c-4fa3-9d8e-65b34d70efdb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1345255 Nov 15 12:40:35.541783 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.584242 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.599696 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb1e86c3-cbb2-41cc-9431-7d9925c75c68 req-cbabec2c-4871-446b-9f4e-accd4bf1541d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814834 Nov 15 12:40:35.682143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.686761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.688868 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a1e085a1-0e6b-4ddf-8334-3548d33a3fd0 HTTP/1.1" status: 204 len: 168 time: 0.2629645 Nov 15 12:40:35.701775 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a73604-e7f1-4ae4-b768-9a86ea0af8c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1e085a1-0e6b-4ddf-8334-3548d33a3fd0,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:35.755858 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-32e014bb-83d9-482e-ad4b-8a8d54e0a087 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:35.992866 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-f7d2d3d0-57a3-431b-9d1f-5cf30d79b347 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/networks?tenant_id=062c8474a5e24cbda37ef168fe1cc426&shared=False HTTP/1.1" status: 200 len: 213 time: 0.4053957 Nov 15 12:40:36.405544 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-53deb94b-c628-4408-b09d-0cd5cd86f8cb tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:36.408040 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-53deb94b-c628-4408-b09d-0cd5cd86f8cb tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3551967 Nov 15 12:40:36.625593 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-de58b83f-2051-4de3-8864-6def0a3e69e9 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/quotas/062c8474a5e24cbda37ef168fe1cc426 HTTP/1.1" status: 200 len: 375 time: 0.1722207 Nov 15 12:40:36.743782 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-12d70997-143b-4bb7-8f2d-6e5f76bd9999 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=062c8474a5e24cbda37ef168fe1cc426&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0920815 Nov 15 12:40:36.872681 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:36.926863 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a7311b-cf43-48a5-86f0-68ef0d60de2d req-61080f99-7e40-485f-a40a-76ed013a2d45 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:36.933617 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1a7311b-cf43-48a5-86f0-68ef0d60de2d req-61080f99-7e40-485f-a40a-76ed013a2d45 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1565990 Nov 15 12:40:36.991696 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.db.resource_extend [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 15 12:40:37.069495 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1a7311b-cf43-48a5-86f0-68ef0d60de2d req-224dfcac-6291-47b4-b847-23fe991ab01a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259818 Nov 15 12:40:37.094548 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-611b4449-d41a-4a01-91eb-3408e284f336 req-2f99f7b0-c82d-4df0-837e-cd4926a9d15c tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 210 time: 0.1400514 Nov 15 12:40:37.250091 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:37.256536 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:37.453101 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Floating IP c863ddfc-191f-4bbe-968a-f38732b415b3 associated. External IP: 172.27.0.101, port: 36928b8a-e800-43e0-9edd-e13ae44ee93e. Nov 15 12:40:37.868223 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:40:38.029572 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:40:38.036960 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.051836 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:40:38.066315 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:40:38.068210 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:40:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:40:38.094346 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f2162bcc-4d69-40b3-8560-b4d218fbf809 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "PUT /v2.0/floatingips/c863ddfc-191f-4bbe-968a-f38732b415b3 HTTP/1.1" status: 200 len: 991 time: 3.0293829 Nov 15 12:40:38.095596 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:38.107110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a11ce096-ac77-49cf-982e-6a588121c48c" -d '{"events": [{"name": "network-changed", "server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:38.128468 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48634) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:38.281112 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:40:38.315363 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.362314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be69d8cd-a7a7-41a5-ac77-4294634269cc req-4eab27a3-4c7d-43d3-b631-566f6b91d057 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:38.366427 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-be69d8cd-a7a7-41a5-ac77-4294634269cc req-4eab27a3-4c7d-43d3-b631-566f6b91d057 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1875341 Nov 15 12:40:38.470558 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-be69d8cd-a7a7-41a5-ac77-4294634269cc req-1e3b15a8-e823-4233-a464-f6601c9a599f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959725 Nov 15 12:40:38.498384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-27d0d768-386a-4641-8393-6e6ebbb41a26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.546032 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32f0a2e5-0f6b-4b96-8e04-e9d7be6648fe x-openstack-request-id: req-32f0a2e5-0f6b-4b96-8e04-e9d7be6648fe {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:38.546303 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:38.546493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-32f0a2e5-0f6b-4b96-8e04-e9d7be6648fe {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:38.546819 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'status': 'completed', 'code': 200} Nov 15 12:40:38.643928 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48648) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:38.830882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11ce096-ac77-49cf-982e-6a588121c48c req-4437fa14-a97c-40b0-acb9-855937a02c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:38.833800 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-4437fa14-a97c-40b0-acb9-855937a02c56 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1098 time: 0.1221039 Nov 15 12:40:38.850509 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-54d8eb88-3925-4aaf-892a-7a5509fd4cad admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.902573 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c863ddfc-191f-4bbe-968a-f38732b415b3', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.101', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:39:55Z', 'updated_at': '2021-11-15T12:40:36Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:40:38.934646 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-15146525-3d9e-46f1-a105-32ff433da8c8 req-7ad3ec37-bf9d-466f-a230-87c6f0bc570a tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 210 time: 0.3219392 Nov 15 12:40:38.973276 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-27d0d768-386a-4641-8393-6e6ebbb41a26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.975850 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:40:38.981331 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-27d0d768-386a-4641-8393-6e6ebbb41a26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:38.993296 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:40:38.994314 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:40:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:40:39.036270 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-27d0d768-386a-4641-8393-6e6ebbb41a26 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=d97c9eb7a614471caad154d30a983371&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9091814 Nov 15 12:40:39.036270 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d0d768-386a-4641-8393-6e6ebbb41a26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eca43c36-df12-48f9-9a92-7a02ccd0082b,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:39.038734 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48654) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:39.047900 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11ce096-ac77-49cf-982e-6a588121c48c req-e9408a34-37b2-4605-b224-9354552882af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:39.049628 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-e9408a34-37b2-4605-b224-9354552882af service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.1888418 Nov 15 12:40:39.126084 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.132647 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.174359 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-54d8eb88-3925-4aaf-892a-7a5509fd4cad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.186099 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.197159 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-54d8eb88-3925-4aaf-892a-7a5509fd4cad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.236196 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-0ae67dff-3ffc-4b68-980a-0d8b77569cff service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 999 time: 0.1696491 Nov 15 12:40:39.255514 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.259418 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.265995 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/eca43c36-df12-48f9-9a92-7a02ccd0082b HTTP/1.1" status: 204 len: 168 time: 0.2208960 Nov 15 12:40:39.287181 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-54d8eb88-3925-4aaf-892a-7a5509fd4cad admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=6e6db059d25347ab9c9be08517ea6ea1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6405356 Nov 15 12:40:39.290479 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b515417-0d74-4d24-aa1b-8714a5128ca4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eca43c36-df12-48f9-9a92-7a02ccd0082b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:39.290873 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48658) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:39.325331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d8eb88-3925-4aaf-892a-7a5509fd4cad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94b057b2-293f-4fff-9104-38e80399b060,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:39.349518 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:40:39.546384 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11ce096-ac77-49cf-982e-6a588121c48c req-160d38bc-10f9-4664-b562-dd61934bc650 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:39.549388 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-160d38bc-10f9-4664-b562-dd61934bc650 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.2033887 Nov 15 12:40:39.584025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.668814 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.745493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264bbce0-9359-4a1a-8ae9-a727ab446cb9 req-9143dcc9-87ff-4cac-abab-6efdcc56cc33 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:39.747555 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-264bbce0-9359-4a1a-8ae9-a727ab446cb9 req-9143dcc9-87ff-4cac-abab-6efdcc56cc33 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1508417 Nov 15 12:40:39.758817 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-27b45745-e421-424e-8f57-56428bc169ad tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.61 "GET /v2.0/networks?tenant_id=062c8474a5e24cbda37ef168fe1cc426&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0752525 Nov 15 12:40:39.772555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11ce096-ac77-49cf-982e-6a588121c48c req-9c84a89f-cc06-4294-be46-b33e19e5760f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:39.779604 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-9c84a89f-cc06-4294-be46-b33e19e5760f service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2123628 Nov 15 12:40:39.866332 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-264bbce0-9359-4a1a-8ae9-a727ab446cb9 req-1e7a76bb-ed24-4b05-854f-86a81769c7b4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035228 Nov 15 12:40:39.921707 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.925854 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:39.927729 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/94b057b2-293f-4fff-9104-38e80399b060 HTTP/1.1" status: 204 len: 168 time: 0.6353693 Nov 15 12:40:40.050931 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c863ddfc-191f-4bbe-968a-f38732b415b3', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.101', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:39:55Z', 'updated_at': '2021-11-15T12:40:36Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:40:40.072313 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48676) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:40.118755 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-77e697b0-aa81-4cb2-815c-e0301a383c26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:40.125465 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33a106b0-77f1-4b18-b2b2-4c8ea955dbac None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c863ddfc-191f-4bbe-968a-f38732b415b3', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.101', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:39:55Z', 'updated_at': '2021-11-15T12:40:36Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:40:40.248705 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5d9f07fe-c6e1-446f-88c4-3f74e3d4e87e req-ec84b61b-a2c3-4be4-9232-cd1401fe88e4 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 210 time: 0.0585289 Nov 15 12:40:40.254985 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda9a799-5163-4d2b-a84e-5ae8358c4aa4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94b057b2-293f-4fff-9104-38e80399b060,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:40.276324 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-d518eb39-6969-4fd4-acdf-480db3557633 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:40.277406 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-d518eb39-6969-4fd4-acdf-480db3557633 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4393599 Nov 15 12:40:40.320980 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-77e697b0-aa81-4cb2-815c-e0301a383c26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:40.327734 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-77e697b0-aa81-4cb2-815c-e0301a383c26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:40.331669 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-fef23c39-b5f0-45eb-804e-f75493048c4c service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4687786 Nov 15 12:40:40.371900 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Request body: {'port': {'device_id': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77', 'admin_state_up': True, 'tenant_id': '062c8474a5e24cbda37ef168fe1cc426'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:40.451343 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-77e697b0-aa81-4cb2-815c-e0301a383c26 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=3d8f61eb943f467f96d06e05847beec7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3771656 Nov 15 12:40:40.459899 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48684) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:40.483176 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e697b0-aa81-4cb2-815c-e0301a383c26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fbdfd8e-cd41-4c66-a2d4-8caa9b772b15,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:40.564712 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-594ca76e-d713-45cb-a008-6faf075ef099 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1730824 Nov 15 12:40:40.663519 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-423fd4a4-1741-4293-ad00-78cf1a771cb3 None None] New status for floating IP c863ddfc-191f-4bbe-968a-f38732b415b3: ACTIVE {{(pid=108288) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:40:40.715280 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48690) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:40.763335 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5d37ec67-4bdf-44a7-823a-36efd13eb6d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:40.779753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-088ff873-8620-4bb4-9725-c11e6fb46c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:40.782538 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-088ff873-8620-4bb4-9725-c11e6fb46c5e service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 1099 time: 0.0754042 Nov 15 12:40:40.941793 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Made reservation on behalf of 062c8474a5e24cbda37ef168fe1cc426 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:40:40.950956 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:40.968027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.021534 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a11ce096-ac77-49cf-982e-6a588121c48c req-278ccaa6-c314-4652-8460-1119ec2a1ff0 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5802705 Nov 15 12:40:41.032861 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-a3c7fdc5-22fb-4831-adfe-5d41086e0765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:41.035014 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-a3c7fdc5-22fb-4831-adfe-5d41086e0765 service neutron] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 916 time: 0.2111347 Nov 15 12:40:41.038612 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.048172 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.115582 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-8211dfd0-b0ed-4832-ada4-1ac9cd05de36 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670 HTTP/1.1" status: 200 len: 217 time: 0.0439684 Nov 15 12:40:41.197919 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-610aea56-7263-4fd6-aeed-cc2ba29e90c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:41.202579 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-610aea56-7263-4fd6-aeed-cc2ba29e90c8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.0585668 Nov 15 12:40:41.222608 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5d37ec67-4bdf-44a7-823a-36efd13eb6d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.233096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5d37ec67-4bdf-44a7-823a-36efd13eb6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.247273 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-ac0b35ae-efa6-4770-98b4-0feb900efab9 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0337296 Nov 15 12:40:41.334643 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54d05f6a-be92-4350-b087-f18100322ee5 req-31c14834-19ed-4bea-b748-de6e6f26f01b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:41.336395 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-54d05f6a-be92-4350-b087-f18100322ee5 req-31c14834-19ed-4bea-b748-de6e6f26f01b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.3011827 Nov 15 12:40:41.365104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.369975 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.389213 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6fbdfd8e-cd41-4c66-a2d4-8caa9b772b15 HTTP/1.1" status: 204 len: 168 time: 0.9152563 Nov 15 12:40:41.389213 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5d37ec67-4bdf-44a7-823a-36efd13eb6d1 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=ef4bfb479f784e589843e30b3ce0e89b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6621029 Nov 15 12:40:41.398403 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48704) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:41.413280 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d37ec67-4bdf-44a7-823a-36efd13eb6d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fda8f98-f03b-4daf-a143-4a20a92517a3,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:41.442256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-353ec473-40e4-4d32-a862-65e852485274 req-e4d653d4-5881-4d44-8281-99ebfcd90d66 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 210 time: 0.0631628 Nov 15 12:40:41.444847 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-4b11e8dc-50a2-46e5-9aa9-62fe84050a46 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1848648 Nov 15 12:40:41.479361 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a747df-8f1b-4053-9ee5-5a7214fc0b93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fbdfd8e-cd41-4c66-a2d4-8caa9b772b15,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:41.583268 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-54d05f6a-be92-4350-b087-f18100322ee5 req-3aff6679-7a72-4991-ab38-7fc84780be5e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2262406 Nov 15 12:40:41.591580 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.604665 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.643184 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.720084 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee8a96ff-be89-40b2-90e4-162d2868e440 req-6862a6f3-3be3-401f-9e17-7d5d2da10d50 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2480853 Nov 15 12:40:41.720744 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b3db8bb1-ff17-44c7-9690-5896c522cc86,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:41.765316 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.903986 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Allocated IP 192.168.233.50 (b250e66d-1b8b-40c2-ac35-c8944138dc77/61d8a135-46cf-41e5-8b91-ce7b3ab5a44c/5a7e144f-2d8f-437e-a8f0-304ee7a644af) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:40:41.939945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.952158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:41.952158 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7fda8f98-f03b-4daf-a143-4a20a92517a3 HTTP/1.1" status: 204 len: 168 time: 0.5466173 Nov 15 12:40:41.972235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d485ca76-1c11-4800-a61b-a038bd28d9d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fda8f98-f03b-4daf-a143-4a20a92517a3,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:42.132072 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.274770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.282047 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48718) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:42.310363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1709d05e-c2f2-4131-b99f-f11c1723338d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.376085 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.491929 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Network b250e66d-1b8b-40c2-ac35-c8944138dc77 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:40:42.507834 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:40:42.513875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Pushing event updated for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:42.518019 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:40:42.598609 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:42.599521 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.614565 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1709d05e-c2f2-4131-b99f-f11c1723338d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.642220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1709d05e-c2f2-4131-b99f-f11c1723338d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:42.865674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d44165c-e456-4775-bdc8-fa1b6ea56a5e req-924ec85e-bf20-4bad-8757-e7830aaba414 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:42.884465 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0d44165c-e456-4775-bdc8-fa1b6ea56a5e req-924ec85e-bf20-4bad-8757-e7830aaba414 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1430275 Nov 15 12:40:42.993667 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-204ec5cd-f2f0-468e-a4d4-80b30a83af11 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.6282434 Nov 15 12:40:43.015434 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0d44165c-e456-4775-bdc8-fa1b6ea56a5e req-68a34bcd-ee71-4df6-b180-9b48b683e998 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1340904 Nov 15 12:40:43.024152 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1709d05e-c2f2-4131-b99f-f11c1723338d admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=9742401512d34621bb4bbe9a92d2889b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7406790 Nov 15 12:40:43.028064 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48738) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:43.034978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-f636bf3a-7459-4e6b-bcc2-a75ac96ee7ff None None] Provisioning complete for port 5a7e144f-2d8f-437e-a8f0-304ee7a644af triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:43.036076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f636bf3a-7459-4e6b-bcc2-a75ac96ee7ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.046203 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1709d05e-c2f2-4131-b99f-f11c1723338d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1afd9b38-02e2-449f-a595-eaeb07f6bc91,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:43.059370 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f9a858-31c5-4c16-a393-0c2589bab8ef req-427dc934-8257-43a8-9034-644f1385f5dc tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:43.061816 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-55f9a858-31c5-4c16-a393-0c2589bab8ef req-427dc934-8257-43a8-9034-644f1385f5dc tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 935 time: 0.4583535 Nov 15 12:40:43.068619 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Request body: {'port': {'device_id': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:43.147844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-f636bf3a-7459-4e6b-bcc2-a75ac96ee7ff None None] Port 5a7e144f-2d8f-437e-a8f0-304ee7a644af cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:40:43.200847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.234499 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-55f9a858-31c5-4c16-a393-0c2589bab8ef req-2ae934b3-0077-47ed-80d4-822afebaa65f tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608465 Nov 15 12:40:43.237486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.306324 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.575770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.578514 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.579903 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/1afd9b38-02e2-449f-a595-eaeb07f6bc91 HTTP/1.1" status: 204 len: 168 time: 0.5501218 Nov 15 12:40:43.609017 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ac29cc-99ac-4530-961a-30da35ff21bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1afd9b38-02e2-449f-a595-eaeb07f6bc91,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:43.818871 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5a7e144f-2d8f-437e-a8f0-304ee7a644af {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:43.831315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:43.854873 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Transition to ACTIVE for port object 5a7e144f-2d8f-437e-a8f0-304ee7a644af will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:43.864085 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:44.187520 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Pushing event updated for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:44.407172 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Attempting to bind port 5a7e144f-2d8f-437e-a8f0-304ee7a644af on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:44.407727 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Attempting to bind port 5a7e144f-2d8f-437e-a8f0-304ee7a644af by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:44.408290 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Attempting to bind port 5a7e144f-2d8f-437e-a8f0-304ee7a644af on network b250e66d-1b8b-40c2-ac35-c8944138dc77 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:44.425128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059f52f1-df27-4b15-8101-a52f8a5b7d32 req-f860f3cc-d90d-450c-ab91-dabee7f21b6f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:44.427780 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-059f52f1-df27-4b15-8101-a52f8a5b7d32 req-f860f3cc-d90d-450c-ab91-dabee7f21b6f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.2421987 Nov 15 12:40:44.439401 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Port 5a7e144f-2d8f-437e-a8f0-304ee7a644af on network b250e66d-1b8b-40c2-ac35-c8944138dc77 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:44.440027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Attempting to bind port 5a7e144f-2d8f-437e-a8f0-304ee7a644af on network b250e66d-1b8b-40c2-ac35-c8944138dc77 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:44.503813 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 40, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:44.504995 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Checking segment: {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:44.505543 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Bound using segment: {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:44.506291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Bound port: 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '43629f4a-6f55-4bf8-a7d1-29c54ac0908c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:44.507577 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:44.620941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb535ea-7d95-4acf-a669-b9f3119f947c req-3a6398c5-2de3-4031-a4a7-4daca8cd1167 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:44.625048 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9eb535ea-7d95-4acf-a669-b9f3119f947c req-3a6398c5-2de3-4031-a4a7-4daca8cd1167 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 947 time: 0.1653025 Nov 15 12:40:44.637064 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-059f52f1-df27-4b15-8101-a52f8a5b7d32 req-294d45f8-6334-473f-9872-0ab5b716ee4c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1729302 Nov 15 12:40:44.708152 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:44.713279 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:44.720724 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:44.767241 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9eb535ea-7d95-4acf-a669-b9f3119f947c req-d4322de2-7fae-47ac-bc2e-f49be4b9ce09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1321118 Nov 15 12:40:44.806255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:44.807348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:44.809866 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] 10.222.0.61 "PUT /v2.0/ports/5a7e144f-2d8f-437e-a8f0-304ee7a644af HTTP/1.1" status: 200 len: 1097 time: 1.7460394 Nov 15 12:40:44.810632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:44.815546 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55" -d '{"events": [{"name": "network-changed", "server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:44.854173 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6969c0-e943-4e15-b739-d02b5222b64c service neutron] Pushing event updated for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:45.087303 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d412403-ff92-481e-b446-db8567693574 x-openstack-request-id: req-9d412403-ff92-481e-b446-db8567693574 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:45.087495 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:45.091482 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-9d412403-ff92-481e-b446-db8567693574 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:45.091926 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af', 'status': 'completed', 'code': 200} Nov 15 12:40:45.118931 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-a1f8c8fd-fb6d-4e4a-8ccc-d04cf1432059 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:45.130080 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-a1f8c8fd-fb6d-4e4a-8ccc-d04cf1432059 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=062c8474a5e24cbda37ef168fe1cc426&device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 1100 time: 0.0966196 Nov 15 12:40:45.191075 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-bc06e398-0d11-4bed-a798-114f578ed0f5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.50&port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af HTTP/1.1" status: 200 len: 217 time: 0.0446618 Nov 15 12:40:45.291538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-372b9629-ca01-4e28-8d06-f4bd1f996e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:45.291538 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-372b9629-ca01-4e28-8d06-f4bd1f996e32 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=61d8a135-46cf-41e5-8b91-ce7b3ab5a44c HTTP/1.1" status: 200 len: 843 time: 0.0800281 Nov 15 12:40:45.315624 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-8a45cad6-b12e-4077-9129-2c46f85b6efe tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:45.318944 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-8a45cad6-b12e-4077-9129-2c46f85b6efe tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.3253040 Nov 15 12:40:45.354608 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-c2c26932-0fec-4665-be9a-bd608e6ddf24 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/quotas/27402858adce449996a04024b968bae3 HTTP/1.1" status: 200 len: 375 time: 0.0211129 Nov 15 12:40:45.401495 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-4435c2b0-cd6e-4b0f-963b-432291582bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:45.404315 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-4435c2b0-cd6e-4b0f-963b-432291582bd2 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b250e66d-1b8b-40c2-ac35-c8944138dc77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0988097 Nov 15 12:40:45.459389 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-8e1b1101-fd38-45c4-95ff-81e3f15399ac tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0946410 Nov 15 12:40:45.621786 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-3f27b5bd-bdd6-47e3-aa1a-870e3ef32c74 service neutron] 10.222.0.61 "GET /v2.0/networks/b250e66d-1b8b-40c2-ac35-c8944138dc77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2045581 Nov 15 12:40:45.704157 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-7a937f79-ab1b-4f4f-8cc7-7d266a33dc5c service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2318869 Nov 15 12:40:45.844943 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-807ecf21-0696-483a-8d14-55cad86e1ae5 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1391630 Nov 15 12:40:45.928410 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-146f76a4-89e9-4a08-a96a-863a0ff0868b req-e5b5766d-ea30-49b4-b72d-28684e89e296 service neutron] 10.222.0.61 "GET /v2.0/networks/b250e66d-1b8b-40c2-ac35-c8944138dc77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2869346 Nov 15 12:40:45.947855 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-257768d5-c672-4b1f-b508-9b16e4285c17 req-03462489-6750-43bb-81d0-1816a43d97f0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:45.950620 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-257768d5-c672-4b1f-b508-9b16e4285c17 req-03462489-6750-43bb-81d0-1816a43d97f0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1353624 Nov 15 12:40:46.083579 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-257768d5-c672-4b1f-b508-9b16e4285c17 req-4c48616f-5eb7-4edb-b2e9-eee05d09fff8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231999 Nov 15 12:40:46.304079 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-3f4784c1-49e7-4942-87fa-9de204940e3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:46.308552 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-3f4784c1-49e7-4942-87fa-9de204940e3d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=062c8474a5e24cbda37ef168fe1cc426&device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 1100 time: 0.1516817 Nov 15 12:40:46.397110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48850) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:46.421532 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014e700f-c8a1-46ff-ad0f-daeaf51a0766 req-6d754aff-547c-447f-b76f-cc52f66b8ce1 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:46.424365 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-014e700f-c8a1-46ff-ad0f-daeaf51a0766 req-6d754aff-547c-447f-b76f-cc52f66b8ce1 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 947 time: 0.1204157 Nov 15 12:40:46.538941 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db7c5588-a446-40f9-a089-253e120a1a66 req-e93cf3bc-c1a0-4846-b710-3a66dbb5f659 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 210 time: 0.0684757 Nov 15 12:40:46.553130 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-014e700f-c8a1-46ff-ad0f-daeaf51a0766 req-303af4da-3240-40da-89b8-11e59ac1ca04 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071229 Nov 15 12:40:46.614411 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-dc0b7392-b503-44a5-8c36-ded6f0d33dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:46.626182 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-dc0b7392-b503-44a5-8c36-ded6f0d33dd7 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b250e66d-1b8b-40c2-ac35-c8944138dc77 HTTP/1.1" status: 200 len: 870 time: 0.2976398 Nov 15 12:40:46.685981 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-be9ee2b3-d8de-4668-8588-8fbbaba09aa0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.50&port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af HTTP/1.1" status: 200 len: 217 time: 0.0493658 Nov 15 12:40:46.701113 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b2a13f76-60e6-4eb6-9cc6-063fb378ee2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:46.832650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-cafca32e-e3c5-4127-a42e-20593448e79b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:46.835602 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-cafca32e-e3c5-4127-a42e-20593448e79b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=61d8a135-46cf-41e5-8b91-ce7b3ab5a44c HTTP/1.1" status: 200 len: 843 time: 0.1353674 Nov 15 12:40:46.856622 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b2a13f76-60e6-4eb6-9cc6-063fb378ee2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:46.862057 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b2a13f76-60e6-4eb6-9cc6-063fb378ee2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:46.918072 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-b2a13f76-60e6-4eb6-9cc6-063fb378ee2b admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=d3923fc8cabf465d8345d894f3106455&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4920514 Nov 15 12:40:46.922069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48868) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:46.925045 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2a13f76-60e6-4eb6-9cc6-063fb378ee2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2d1668b-5635-43ef-b8e6-eba9447da131,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:46.997482 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-f8ac2a83-8457-4608-bbf6-57212d1d7e00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:46.999953 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-f8ac2a83-8457-4608-bbf6-57212d1d7e00 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b250e66d-1b8b-40c2-ac35-c8944138dc77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1459165 Nov 15 12:40:47.034311 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:47.154329 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:47.278638 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-02d48399-1902-44d8-9718-2a9dd0950d70 service neutron] 10.222.0.61 "GET /v2.0/networks/b250e66d-1b8b-40c2-ac35-c8944138dc77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2606730 Nov 15 12:40:47.330902 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:47.339684 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:47.341143 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a2d1668b-5635-43ef-b8e6-eba9447da131 HTTP/1.1" status: 204 len: 168 time: 0.4174950 Nov 15 12:40:47.353096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-709237d2-d9ef-497d-b72f-86800fb29467 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2d1668b-5635-43ef-b8e6-eba9447da131,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:47.377102 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47dc8b1b-a3c4-4eaf-898a-ca5c1059f96c req-f13c0020-a606-4066-b524-ed96cd0a7906 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:47.381267 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-47dc8b1b-a3c4-4eaf-898a-ca5c1059f96c req-f13c0020-a606-4066-b524-ed96cd0a7906 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1383493 Nov 15 12:40:47.488202 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-47dc8b1b-a3c4-4eaf-898a-ca5c1059f96c req-f9634a44-b40f-4368-a9df-8838491efc76 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954309 Nov 15 12:40:47.694804 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec554ce6-0516-40e9-b78c-95c4bbdb0f55 req-1cd91bc8-d1c6-4aed-aaee-427d93f614f1 service neutron] 10.222.0.61 "GET /v2.0/networks/b250e66d-1b8b-40c2-ac35-c8944138dc77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2733357 Nov 15 12:40:47.775317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a87141-8e49-4f43-8b6c-ada9f51cec86 req-c01de20b-89e5-4b90-8954-4d1824043b2e tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:47.788842 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-14a87141-8e49-4f43-8b6c-ada9f51cec86 req-c01de20b-89e5-4b90-8954-4d1824043b2e tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 947 time: 0.1013880 Nov 15 12:40:47.830193 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bd15c01b-9dad-4e0f-af38-d119c3bfd6fd req-178437d7-b6af-4e09-8ce2-24010ea62add tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 210 time: 0.0431962 Nov 15 12:40:47.889631 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-14a87141-8e49-4f43-8b6c-ada9f51cec86 req-167774cd-9c99-4ba7-a63c-4a420517d216 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996404 Nov 15 12:40:48.005128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 48898) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:48.022987 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a3e129d8-cedc-40aa-b6a3-fb62ee8f092d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.141948 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a3e129d8-cedc-40aa-b6a3-fb62ee8f092d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.146211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a3e129d8-cedc-40aa-b6a3-fb62ee8f092d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.203096 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a3e129d8-cedc-40aa-b6a3-fb62ee8f092d admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=4af598c231b4487a926576432aea7547&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1961031 Nov 15 12:40:48.205897 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e129d8-cedc-40aa-b6a3-fb62ee8f092d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d286bfe6-7195-4298-811a-ca58a8aeb3c7,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:48.207257 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 48900) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:48.311612 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.351732 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.435126 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.437927 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:48.444826 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/d286bfe6-7195-4298-811a-ca58a8aeb3c7 HTTP/1.1" status: 204 len: 168 time: 0.2254291 Nov 15 12:40:48.449791 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7ec950-6ce0-4b91-8f04-dd8dbcee9a03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d286bfe6-7195-4298-811a-ca58a8aeb3c7,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:48.764825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad34e72-6b53-43d6-94ab-cc1bc1e773bb req-1f5df880-ae39-48d2-9b42-26b8491f95dd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:48.768477 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cad34e72-6b53-43d6-94ab-cc1bc1e773bb req-1f5df880-ae39-48d2-9b42-26b8491f95dd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1552846 Nov 15 12:40:48.826102 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-6d4f3996-b1d0-40f7-b43d-dffd23abe839 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:48.828662 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-6d4f3996-b1d0-40f7-b43d-dffd23abe839 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.2290266 Nov 15 12:40:48.874839 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cad34e72-6b53-43d6-94ab-cc1bc1e773bb req-f3b848f0-050e-4452-a046-f257474375ee tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853505 Nov 15 12:40:48.888168 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Request body: {'port': {'device_id': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'admin_state_up': True, 'tenant_id': '27402858adce449996a04024b968bae3'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:49.076857 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f10f293-0aa5-49de-b94c-f1303ee12b93 req-399ccc8c-41c4-4177-b0be-35e8abe5a18a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 210 time: 0.0598419 Nov 15 12:40:49.133091 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:40:49.140114 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:49.163482 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f509ad1b-26eb-4eed-9c86-36fc06fe8fb3 req-6e2208bd-533d-4f9f-ae40-d1f1efee4b77 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:49.167185 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f509ad1b-26eb-4eed-9c86-36fc06fe8fb3 req-6e2208bd-533d-4f9f-ae40-d1f1efee4b77 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 947 time: 0.0909853 Nov 15 12:40:49.264790 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f509ad1b-26eb-4eed-9c86-36fc06fe8fb3 req-4173b0e9-d4e3-4441-ae39-a0aa89f2c90a tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803521 Nov 15 12:40:49.366434 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Allocated IP 172.20.0.9 (e836cde6-4e01-43bc-9750-09587b9bb5d0/65d6a75d-c74e-4d29-a0f1-5b5b6db06715/9e843abc-71ca-433a-a92b-f035c2503fb4) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:40:49.638859 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:49.696852 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:49.748846 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:40:49.758515 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:40:49.760179 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:40:49.763644 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:49.790504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event updated for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:49.837618 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:49.838872 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:49.868415 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-2acf0ec9-2bc7-47a3-8879-2e9ed81bd896 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9918666 Nov 15 12:40:49.905672 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Request body: {'port': {'device_id': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:40:50.015826 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:50.236984 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c967eb-6e39-4540-a1a3-68e098ae1287 req-30c7361f-5a61-4466-8648-123e654e0b41 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:50.240446 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-11c967eb-6e39-4540-a1a3-68e098ae1287 req-30c7361f-5a61-4466-8648-123e654e0b41 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1301835 Nov 15 12:40:50.377630 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-11c967eb-6e39-4540-a1a3-68e098ae1287 req-083c9b1e-49f4-4423-95d1-5b7c0142a437 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285644 Nov 15 12:40:50.383449 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550cf0c0-6847-42d2-9c75-181485b21222 req-2ee54ae9-648d-4aac-afbe-b5c11c96d893 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:50.385825 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5a7e144f-2d8f-437e-a8f0-304ee7a644af details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:50.399619 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-550cf0c0-6847-42d2-9c75-181485b21222 req-2ee54ae9-648d-4aac-afbe-b5c11c96d893 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 931 time: 0.1235049 Nov 15 12:40:50.596595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-550cf0c0-6847-42d2-9c75-181485b21222 req-bad2856e-950a-4db4-88af-702a480368f4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1860759 Nov 15 12:40:50.629402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:50.654152 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '5a7e144f-2d8f-437e-a8f0-304ee7a644af', 'network_id': 'b250e66d-1b8b-40c2-ac35-c8944138dc77', 'port_id': '5a7e144f-2d8f-437e-a8f0-304ee7a644af', 'mac_address': 'fa:16:3e:ba:46:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '61d8a135-46cf-41e5-8b91-ce7b3ab5a44c', 'ip_address': '192.168.233.50'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:50.669983 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d01d3ab-02f3-48e3-9899-110ce4f377aa req-20140dc6-c68c-474d-aed6-c37f89a898b3 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:50.672870 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7d01d3ab-02f3-48e3-9899-110ce4f377aa req-20140dc6-c68c-474d-aed6-c37f89a898b3 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 947 time: 0.1420326 Nov 15 12:40:50.716260 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:50.733913 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5a7e144f-2d8f-437e-a8f0-304ee7a644af {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:50.758674 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:50.763458 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:50.826881 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e843abc-71ca-433a-a92b-f035c2503fb4 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:50.843922 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:50.856156 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:50.870865 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.871093 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7d01d3ab-02f3-48e3-9899-110ce4f377aa req-9f7ab890-a444-4b01-8d60-708dd5c5dbb6 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1827221 Nov 15 12:40:50.871684 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.872169 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.872559 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.873061 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.873397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.873727 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.874055 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.874403 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.874717 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.875268 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.875512 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:40:50.911562 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Transition to ACTIVE for port object 9e843abc-71ca-433a-a92b-f035c2503fb4 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:40:50.918473 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:51.010244 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Pushing event updated for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:51.155405 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Attempting to bind port 9e843abc-71ca-433a-a92b-f035c2503fb4 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:40:51.156277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Attempting to bind port 9e843abc-71ca-433a-a92b-f035c2503fb4 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:40:51.156952 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Attempting to bind port 9e843abc-71ca-433a-a92b-f035c2503fb4 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:51.166431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Port 9e843abc-71ca-433a-a92b-f035c2503fb4 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:40:51.166810 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Attempting to bind port 9e843abc-71ca-433a-a92b-f035c2503fb4 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:40:51.175410 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 40, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:40:51.176411 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Checking segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:40:51.177165 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Bound using segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:40:51.177566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Bound port: 9e843abc-71ca-433a-a92b-f035c2503fb4, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:40:51.178006 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:51.371549 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:40:51.378479 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9e843abc-71ca-433a-a92b-f035c2503fb4,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:40:51.385863 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:51.469318 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:51.471485 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:51.474899 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] 10.222.0.61 "PUT /v2.0/ports/9e843abc-71ca-433a-a92b-f035c2503fb4 HTTP/1.1" status: 200 len: 1093 time: 1.5768750 Nov 15 12:40:51.475624 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:51.483040 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af1cecc5-b2d4-4183-81a6-83409350a4bb" -d '{"events": [{"name": "network-changed", "server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:51.548518 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdb6f16-4945-4de6-87f6-a260b5810a68 service neutron] Pushing event updated for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:51.585908 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32d1dc44-7ee4-437b-a16a-f63132d0b495 x-openstack-request-id: req-32d1dc44-7ee4-437b-a16a-f63132d0b495 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:51.586581 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:51.587052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-32d1dc44-7ee4-437b-a16a-f63132d0b495 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:51.587923 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4', 'status': 'completed', 'code': 200} Nov 15 12:40:51.592886 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['5a7e144f-2d8f-437e-a8f0-304ee7a644af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:51.760861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-122aaaee-e456-4d22-a222-b1d1d4658ba7 req-de8ac77e-bd65-45e9-af2d-9fb3f14aae5a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:51.773957 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-122aaaee-e456-4d22-a222-b1d1d4658ba7 req-de8ac77e-bd65-45e9-af2d-9fb3f14aae5a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1916108 Nov 15 12:40:51.809704 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-5d58bfb5-fb05-4036-8d42-92e1b0727722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:51.812563 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-5d58bfb5-fb05-4036-8d42-92e1b0727722 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 1096 time: 0.1579432 Nov 15 12:40:51.875101 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe823e5-fb0e-4a1e-b4fe-8a44dcb59037 req-706b2731-8d87-4d34-8aa2-0ccfb29e5f65 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:51.878925 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4fe823e5-fb0e-4a1e-b4fe-8a44dcb59037 req-706b2731-8d87-4d34-8aa2-0ccfb29e5f65 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 943 time: 0.1411345 Nov 15 12:40:51.945415 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-42d8a0a0-e6ef-4ea7-88d9-43937bb2a911 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e843abc-71ca-433a-a92b-f035c2503fb4 HTTP/1.1" status: 200 len: 217 time: 0.0827761 Nov 15 12:40:51.961149 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-122aaaee-e456-4d22-a222-b1d1d4658ba7 req-6c0a7720-ced3-4fcc-9760-3b71d7ca3dd4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1854043 Nov 15 12:40:52.059605 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4fe823e5-fb0e-4a1e-b4fe-8a44dcb59037 req-a3a56d14-dca7-41e9-8f68-e46b7de68974 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1662414 Nov 15 12:40:52.105754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-6b0d1992-59aa-4ca3-b473-2df4a2be6dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:52.108040 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-6b0d1992-59aa-4ca3-b473-2df4a2be6dd0 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.1402767 Nov 15 12:40:52.231373 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-bbaf80b0-f6cc-4678-8436-2352bf6a4179 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0680373 Nov 15 12:40:52.255690 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef1901f-1563-48c1-a0ef-e8721c939d3a req-6acf5f89-95ed-49c8-aa0f-9e2716012016 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:52.257333 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6ef1901f-1563-48c1-a0ef-e8721c939d3a req-6acf5f89-95ed-49c8-aa0f-9e2716012016 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 948 time: 0.1137259 Nov 15 12:40:52.385544 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6ef1901f-1563-48c1-a0ef-e8721c939d3a req-9f730d9b-cb45-4eee-b173-8caace045634 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1091676 Nov 15 12:40:52.399558 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-33da47dc-bb2e-40ec-bd6e-9ecc4b7e5417 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1409545 Nov 15 12:40:52.522308 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e02de98-ddcf-43b6-8e60-1a3bee799e2b req-46884895-365f-4444-8102-ec71118ea8f3 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1117215 Nov 15 12:40:52.787141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-d4833ae3-c332-475f-9a69-ddd5c8c81a5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:52.790821 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-d4833ae3-c332-475f-9a69-ddd5c8c81a5b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 1096 time: 0.0621295 Nov 15 12:40:53.007767 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-2e1fe843-df95-4119-8193-7264751bf334 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:53.010927 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-2e1fe843-df95-4119-8193-7264751bf334 service neutron] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 916 time: 0.2004733 Nov 15 12:40:53.160716 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a43da2-d26a-4972-b009-6d07d29f65f5 req-abbd9971-3346-4adf-93c2-ca09dc467d55 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:53.175194 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46a43da2-d26a-4972-b009-6d07d29f65f5 req-abbd9971-3346-4adf-93c2-ca09dc467d55 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0879383 Nov 15 12:40:53.279109 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46a43da2-d26a-4972-b009-6d07d29f65f5 req-b5e48f1a-1c2e-430e-a25c-d9d582407737 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019211 Nov 15 12:40:53.296699 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-c23f8b52-a710-4238-a4cf-089b89120c38 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e843abc-71ca-433a-a92b-f035c2503fb4 HTTP/1.1" status: 200 len: 217 time: 0.1295824 Nov 15 12:40:53.394937 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba50140-e21b-4ff4-943f-4690d8794f12 req-8a68f703-4285-4d3c-8df5-19b87df6f7c8 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:53.404386 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6ba50140-e21b-4ff4-943f-4690d8794f12 req-8a68f703-4285-4d3c-8df5-19b87df6f7c8 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.2968142 Nov 15 12:40:53.442472 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-240f0d8d-1344-4d57-b938-49b714629a2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:53.443961 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-240f0d8d-1344-4d57-b938-49b714629a2b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.1283348 Nov 15 12:40:53.466167 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d42a331-1421-47fe-968a-bc0955d6c728 req-4c6ed748-0492-4ab5-928e-b3d76487f2c1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:53.469008 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4d42a331-1421-47fe-968a-bc0955d6c728 req-4c6ed748-0492-4ab5-928e-b3d76487f2c1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 943 time: 0.0980296 Nov 15 12:40:53.502857 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6ba50140-e21b-4ff4-943f-4690d8794f12 req-8e7ac904-578b-45c1-a1a5-3f1033e2bcfb tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0963047 Nov 15 12:40:53.536533 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-12f44c0d-d239-487f-a97e-7d2ee2b4d524 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0692041 Nov 15 12:40:53.563940 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4d42a331-1421-47fe-968a-bc0955d6c728 req-7e1ba2d3-57ad-4f4e-bacc-5cf9ff1ef9e6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817840 Nov 15 12:40:53.775894 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:40:54.042025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b27f44-00ba-4f37-a527-d3c1736e358b req-37a31226-3df0-449f-b8a5-8a649b2bae96 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:54.043091 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-44b27f44-00ba-4f37-a527-d3c1736e358b req-37a31226-3df0-449f-b8a5-8a649b2bae96 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 948 time: 0.3986990 Nov 15 12:40:54.055079 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-4d777767-cc71-4123-9c1f-db6301b6db02 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5044711 Nov 15 12:40:54.182400 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-44b27f44-00ba-4f37-a527-d3c1736e358b req-a94fdc60-39d8-4621-82e6-2d0db765ae44 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259298 Nov 15 12:40:54.246566 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af1cecc5-b2d4-4183-81a6-83409350a4bb req-ce3891bb-e4c3-413d-933c-9cbce05d8900 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1768835 Nov 15 12:40:54.404040 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5a7e144f-2d8f-437e-a8f0-304ee7a644af up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:40:54.498123 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2405cce-76b3-4b4f-bd6f-db94c3336d91 req-5af73472-8c7a-4e45-ab95-1552a854f17e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:54.501480 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b2405cce-76b3-4b4f-bd6f-db94c3336d91 req-5af73472-8c7a-4e45-ab95-1552a854f17e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0998561 Nov 15 12:40:54.510515 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 5a7e144f-2d8f-437e-a8f0-304ee7a644af completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:40:54.518034 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 5a7e144f-2d8f-437e-a8f0-304ee7a644af triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:40:54.518966 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:54.591673 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b2405cce-76b3-4b4f-bd6f-db94c3336d91 req-41b003ac-a17a-4c68-acbd-9b8190824e4a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741560 Nov 15 12:40:54.678051 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:54.704897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:40:54.707938 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-986477e3-4879-432a-a586-a239a991c0c3" -d '{"events": [{"server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "name": "network-vif-plugged", "status": "completed", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:40:54.729650 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:54.735705 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:54.745694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a7326-2846-4753-a9b1-cd0a35a2fef4 req-fb6e046f-ef4c-466b-bd22-f78179502e58 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:54.759157 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-436a7326-2846-4753-a9b1-cd0a35a2fef4 req-fb6e046f-ef4c-466b-bd22-f78179502e58 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1081209 Nov 15 12:40:54.805730 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7e172d-3e5e-45a8-81c2-ed10b519ed33 req-4feb02d7-08b5-4fbb-ba41-f81d9d77cd94 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:54.807313 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e7e172d-3e5e-45a8-81c2-ed10b519ed33 req-4feb02d7-08b5-4fbb-ba41-f81d9d77cd94 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 943 time: 0.0913165 Nov 15 12:40:54.828159 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:54.865438 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-436a7326-2846-4753-a9b1-cd0a35a2fef4 req-32e10868-d040-47c4-81bd-dac914947a10 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040592 Nov 15 12:40:54.893687 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e7e172d-3e5e-45a8-81c2-ed10b519ed33 req-bad3fda3-5eb4-43e3-a43c-c212053220cc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746281 Nov 15 12:40:54.936040 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:40:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-283b0ec1-f69c-4536-ab26-93187565533c x-openstack-request-id: req-283b0ec1-f69c-4536-ab26-93187565533c {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:40:54.936619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "name": "network-vif-plugged", "status": "completed", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:40:54.937639 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-283b0ec1-f69c-4536-ab26-93187565533c {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:40:54.937639 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af', 'code': 200} Nov 15 12:40:55.284640 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0566066-323a-443f-b5a9-ff703c2e2935 req-bde44fd6-5ac4-4956-b105-59ba8e5b1599 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:55.287014 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b0566066-323a-443f-b5a9-ff703c2e2935 req-bde44fd6-5ac4-4956-b105-59ba8e5b1599 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 1102 time: 0.0538349 Nov 15 12:40:55.379558 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469ab3dc-0b55-43da-9758-8a6aa4c716c8 req-e1a70f06-11f3-489e-9e44-f332045618e8 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:55.381230 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-469ab3dc-0b55-43da-9758-8a6aa4c716c8 req-e1a70f06-11f3-489e-9e44-f332045618e8 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0930445 Nov 15 12:40:55.384532 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b0566066-323a-443f-b5a9-ff703c2e2935 req-6df0b064-8ebd-4087-9c46-1806ddb54110 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863800 Nov 15 12:40:55.439284 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-469ab3dc-0b55-43da-9758-8a6aa4c716c8 req-e2ed6b20-e70f-481f-8227-de489a30ae05 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494945 Nov 15 12:40:55.752800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25ac7c04-7a7f-40c4-9c00-7ac52f009849 req-fad4185c-e479-41b9-b0fe-3fa0695ba6aa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:55.754452 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-25ac7c04-7a7f-40c4-9c00-7ac52f009849 req-fad4185c-e479-41b9-b0fe-3fa0695ba6aa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0646720 Nov 15 12:40:55.816892 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-25ac7c04-7a7f-40c4-9c00-7ac52f009849 req-5c3a202d-9420-48ca-b4b7-9a09aff19846 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556190 Nov 15 12:40:56.037821 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342828dc-19ea-4d24-b46f-a9f13f9bd3eb req-5bbebcd8-4c65-45c2-890e-0523bd7962aa tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:56.040509 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-342828dc-19ea-4d24-b46f-a9f13f9bd3eb req-5bbebcd8-4c65-45c2-890e-0523bd7962aa tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.0691109 Nov 15 12:40:56.074469 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb8c3ef4-97b0-4982-a7cb-6107c5786c35 req-1fb272c8-f324-4ae3-b01f-fe2943ea720e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:56.075920 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb8c3ef4-97b0-4982-a7cb-6107c5786c35 req-1fb272c8-f324-4ae3-b01f-fe2943ea720e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 943 time: 0.0687618 Nov 15 12:40:56.123899 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-342828dc-19ea-4d24-b46f-a9f13f9bd3eb req-c84d15e9-36f6-4207-9e6c-0f78cd61e9b0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766108 Nov 15 12:40:56.212505 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb8c3ef4-97b0-4982-a7cb-6107c5786c35 req-b1bb13f1-a8a6-4d41-b199-44b98d37681b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202657 Nov 15 12:40:56.260403 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49130) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:56.396286 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9e843abc-71ca-433a-a92b-f035c2503fb4 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:40:56.426606 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-68521527-4d70-4884-b51f-e51c92adecad admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.564057 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9e843abc-71ca-433a-a92b-f035c2503fb4,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:56.586474 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '9e843abc-71ca-433a-a92b-f035c2503fb4', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'port_id': '9e843abc-71ca-433a-a92b-f035c2503fb4', 'mac_address': 'fa:16:3e:46:2f:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 647, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65d6a75d-c74e-4d29-a0f1-5b5b6db06715', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:40:56.589390 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-68521527-4d70-4884-b51f-e51c92adecad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.595413 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-68521527-4d70-4884-b51f-e51c92adecad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.661791 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-68521527-4d70-4884-b51f-e51c92adecad admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=550e81f89e14461b97316d47ab8731f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3972259 Nov 15 12:40:56.661791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68521527-4d70-4884-b51f-e51c92adecad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2958aa0-ea68-45c8-98ab-6ce15ff8fe1a,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:56.664094 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.664668 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b10f2d7-4924-4ff9-bb20-7d631a4d19b2 req-18a42e4c-ee05-4749-8634-18d2ce4ee887 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:56.667186 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49138) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:56.672510 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b10f2d7-4924-4ff9-bb20-7d631a4d19b2 req-18a42e4c-ee05-4749-8634-18d2ce4ee887 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.1103313 Nov 15 12:40:56.693155 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49140) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:56.701227 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e843abc-71ca-433a-a92b-f035c2503fb4 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:40:56.730663 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9e843abc-71ca-433a-a92b-f035c2503fb4,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:56.737323 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.763584 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b10f2d7-4924-4ff9-bb20-7d631a4d19b2 req-8678c83b-31cb-4cce-b5fc-50855d778d8c tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883799 Nov 15 12:40:56.769583 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.803166 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.832246 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:56.912497 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.916604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.917778 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f2958aa0-ea68-45c8-98ab-6ce15ff8fe1a HTTP/1.1" status: 204 len: 168 time: 0.2494371 Nov 15 12:40:56.923790 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-714e469d-5fc0-4448-a417-aad5ee106177 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:56.962935 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-496b1890-dcba-4fd1-b1ea-e4102b8c92a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2958aa0-ea68-45c8-98ab-6ce15ff8fe1a,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:56.996663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd5779b-78ce-42ec-a287-7fa65b1eed4f req-4f979282-c88d-41d8-ba8e-78af9ec44766 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:56.999850 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-edd5779b-78ce-42ec-a287-7fa65b1eed4f req-4f979282-c88d-41d8-ba8e-78af9ec44766 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0923178 Nov 15 12:40:57.074358 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-714e469d-5fc0-4448-a417-aad5ee106177 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.079783 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-edd5779b-78ce-42ec-a287-7fa65b1eed4f req-f000798c-856d-4bba-8605-42f0a775368a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660162 Nov 15 12:40:57.080111 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-714e469d-5fc0-4448-a417-aad5ee106177 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.124092 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-714e469d-5fc0-4448-a417-aad5ee106177 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=3ab533519b25433e8be4d27973dc0bb9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4289305 Nov 15 12:40:57.126286 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49152) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:57.132927 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-714e469d-5fc0-4448-a417-aad5ee106177 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66e40c02-8ef3-4984-8072-b80ba4a357d4,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:57.206318 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.251843 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.398615 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed4450a-7e5a-40c8-8ea9-42df5b464e43 req-5eefe56b-004f-40f1-98fe-b7c021b693eb tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:57.400273 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5ed4450a-7e5a-40c8-8ea9-42df5b464e43 req-5eefe56b-004f-40f1-98fe-b7c021b693eb tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1152833 Nov 15 12:40:57.402638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49166) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:57.422867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1a70a7d5-06fb-4a84-9d08-f9b59d713125 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.427376 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c841d2a-61a0-459d-9e94-340a5f29757a req-1e3ffe15-bbdf-46d0-93a8-139741b64bb0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:57.430460 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3c841d2a-61a0-459d-9e94-340a5f29757a req-1e3ffe15-bbdf-46d0-93a8-139741b64bb0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 944 time: 0.1054332 Nov 15 12:40:57.444942 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.447630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.453522 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/66e40c02-8ef3-4984-8072-b80ba4a357d4 HTTP/1.1" status: 204 len: 168 time: 0.3216836 Nov 15 12:40:57.465747 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e6ee90-defa-44e8-95af-a1d9a2a666e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66e40c02-8ef3-4984-8072-b80ba4a357d4,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:57.503466 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5ed4450a-7e5a-40c8-8ea9-42df5b464e43 req-ee75975e-db52-4bb5-a744-c7e8b324f2c4 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825355 Nov 15 12:40:57.529282 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3c841d2a-61a0-459d-9e94-340a5f29757a req-ce414ea2-3248-4c24-8987-81482be68a79 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870695 Nov 15 12:40:57.608903 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1a70a7d5-06fb-4a84-9d08-f9b59d713125 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.615494 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1a70a7d5-06fb-4a84-9d08-f9b59d713125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.675362 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a70a7d5-06fb-4a84-9d08-f9b59d713125 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fdc614e-cff2-4513-b959-4989e2255c6f,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:57.681918 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1a70a7d5-06fb-4a84-9d08-f9b59d713125 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=f5ead1091d69494e85ede927c837c5bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2779641 Nov 15 12:40:57.685210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49172) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:57.753307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.787910 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.889678 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.895331 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:57.897934 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/4fdc614e-cff2-4513-b959-4989e2255c6f HTTP/1.1" status: 204 len: 168 time: 0.2113984 Nov 15 12:40:57.919365 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54373dd3-d26d-4aab-a320-48e1918b952e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fdc614e-cff2-4513-b959-4989e2255c6f,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:57.949052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6971c30-95f0-4803-a63a-1797ec3543de req-30eb8641-23f8-4062-8a6a-c205934d9278 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:57.953260 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6971c30-95f0-4803-a63a-1797ec3543de req-30eb8641-23f8-4062-8a6a-c205934d9278 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0935271 Nov 15 12:40:57.972182 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['9e843abc-71ca-433a-a92b-f035c2503fb4'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:58.059282 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6971c30-95f0-4803-a63a-1797ec3543de req-abca9cb3-f849-4803-8b30-cb6dc529c95c tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970454 Nov 15 12:40:58.104635 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49180) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:58.126261 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb516dfe-e115-4e87-93c9-405ad0f2cba9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.252486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb516dfe-e115-4e87-93c9-405ad0f2cba9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.260574 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb516dfe-e115-4e87-93c9-405ad0f2cba9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.311815 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb516dfe-e115-4e87-93c9-405ad0f2cba9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6feb2f9-214e-43a5-bdea-03c97fceb732,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:58.317696 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-eb516dfe-e115-4e87-93c9-405ad0f2cba9 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=7aa0426b2833438695894d95b5613a8d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2119141 Nov 15 12:40:58.327215 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49190) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:58.407440 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8444a2a3-c5d4-41c7-b839-4c58862a6ce7 req-14903d6c-b74e-4db4-ac51-dd199af40df9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:58.420190 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8444a2a3-c5d4-41c7-b839-4c58862a6ce7 req-14903d6c-b74e-4db4-ac51-dd199af40df9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1597857 Nov 15 12:40:58.513301 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8444a2a3-c5d4-41c7-b839-4c58862a6ce7 req-38430639-13e1-4cd8-9e0f-5a4921edddf4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918076 Nov 15 12:40:58.514448 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.569738 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.613814 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-014bfa9d-bb50-48c1-9d69-e8b1dfcdf7c3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:58.616737 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-014bfa9d-bb50-48c1-9d69-e8b1dfcdf7c3 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.61 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1291530 Nov 15 12:40:58.670396 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.675998 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:58.684727 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e6feb2f9-214e-43a5-bdea-03c97fceb732 HTTP/1.1" status: 204 len: 168 time: 0.3537829 Nov 15 12:40:58.715781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fbcde0-6f4d-4e46-bba1-70d05dd3e53f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6feb2f9-214e-43a5-bdea-03c97fceb732,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:58.855547 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2771380-3506-41fa-93fa-4c54971169bc req-18617202-770d-4e02-88e1-b61b2b18beb8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:58.860055 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2771380-3506-41fa-93fa-4c54971169bc req-18617202-770d-4e02-88e1-b61b2b18beb8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 944 time: 0.1213892 Nov 15 12:40:58.881804 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b2cc42-7bd6-424b-88ca-3776cc6dc4f9 req-50e6a7d7-1e3a-4410-b75d-57df40302cc1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:58.883396 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78b2cc42-7bd6-424b-88ca-3776cc6dc4f9 req-50e6a7d7-1e3a-4410-b75d-57df40302cc1 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 946 time: 0.1519670 Nov 15 12:40:58.953047 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2771380-3506-41fa-93fa-4c54971169bc req-6e61ee07-7307-4fc0-93e4-974c153c89c6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810583 Nov 15 12:40:59.020303 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78b2cc42-7bd6-424b-88ca-3776cc6dc4f9 req-79b5ced0-7c27-42b6-a080-4ece1fd1030b tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/security-groups?id=3d568b54-8b67-4b41-939c-80772461a0cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160522 Nov 15 12:40:59.028344 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Deleting port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:40:59.028902 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.255455 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] For port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,segment=NetworkSegment(42712e6e-6181-4ceb-bdda-98824d122256),segment_id=42712e6e-6181-4ceb-bdda-98824d122256)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:40:59.255904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.282362 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49222) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:59.285460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Calling delete_port for cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:40:59.325607 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c68e65-7487-4b3b-90df-135805bffbe6 req-a48c2260-c3ec-4867-9d9e-098f0d83f336 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:59.327599 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b6c68e65-7487-4b3b-90df-135805bffbe6 req-a48c2260-c3ec-4867-9d9e-098f0d83f336 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.1551983 Nov 15 12:40:59.351093 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4ef819eb-6368-41d7-983f-b14cc8b4e12a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.549102 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b6c68e65-7487-4b3b-90df-135805bffbe6 req-f6fc4a2c-e879-4a8a-a2bb-b6d7275bfde3 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2052333 Nov 15 12:40:59.708238 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a3436fb-a08d-4fe5-934e-11d9c7d77f78 req-357d89a2-8fdd-4f85-ab2f-215fa6bf5f94 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:40:59.721950 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8a3436fb-a08d-4fe5-934e-11d9c7d77f78 req-357d89a2-8fdd-4f85-ab2f-215fa6bf5f94 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0924509 Nov 15 12:40:59.724077 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4ef819eb-6368-41d7-983f-b14cc8b4e12a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.737555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4ef819eb-6368-41d7-983f-b14cc8b4e12a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.784952 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:40:59.823833 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8a3436fb-a08d-4fe5-934e-11d9c7d77f78 req-fb4cc792-adaf-4888-845a-d5e9a6f886e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000402 Nov 15 12:40:59.874414 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4ef819eb-6368-41d7-983f-b14cc8b4e12a admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b623d7acd5fe4ed598a734d0052659c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5825946 Nov 15 12:40:59.879443 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49236) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:40:59.880512 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['cf81a6f4-3d88-4d0e-b9d2-b79c61aea820'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:40:59.883245 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef819eb-6368-41d7-983f-b14cc8b4e12a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6095ef6-05d0-4742-a4cc-99b9f9a5e455,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:40:59.902652 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Pushing event deleted for resources: {'Port': ['ID=cf81a6f4-3d88-4d0e-b9d2-b79c61aea820,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:00.035664 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.059209 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] No DVR routers for this DVR port cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:41:00.067804 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.075440 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-02bb23a5-dc52-42f8-b1f3-bc1d1190ed22 req-6fa47808-a2c7-456b-af66-1aa0e5124cc0 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.61 "DELETE /v2.0/ports/cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 HTTP/1.1" status: 204 len: 173 time: 1.4463744 Nov 15 12:41:00.076354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'name': 'network-vif-deleted', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:00.083271 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4366383d-a134-4e72-b139-007400f3cf60" -d '{"events": [{"server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "name": "network-vif-deleted", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:00.108024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.143116 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e260d9-3898-456f-91e5-74a4d15e5bd3 req-8a9ab50d-a011-4318-b3cb-44856633191f tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:00.149352 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-05e260d9-3898-456f-91e5-74a4d15e5bd3 req-8a9ab50d-a011-4318-b3cb-44856633191f tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0930660 Nov 15 12:41:00.177102 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5ebf28-d852-423a-93ef-ebe8ec1dbb07 req-694b7fcf-a8e6-49c0-874c-1d0baa9e6350 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:00.179024 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7e5ebf28-d852-423a-93ef-ebe8ec1dbb07 req-694b7fcf-a8e6-49c0-874c-1d0baa9e6350 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 944 time: 0.0822928 Nov 15 12:41:00.264104 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.268708 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.279031 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e6095ef6-05d0-4742-a4cc-99b9f9a5e455 HTTP/1.1" status: 204 len: 168 time: 0.3966377 Nov 15 12:41:00.288441 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7e5ebf28-d852-423a-93ef-ebe8ec1dbb07 req-506530b7-a790-48c9-b852-65c62cc4d17a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847907 Nov 15 12:41:00.303947 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-05e260d9-3898-456f-91e5-74a4d15e5bd3 req-73faed90-3da8-465e-b954-ab84a2089bc7 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385736 Nov 15 12:41:00.334122 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf86331-989f-4028-849b-5513cf9b94f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6095ef6-05d0-4742-a4cc-99b9f9a5e455,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:00.419555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e034f8d8-b44c-40a4-a423-a75ae1873dc0 x-openstack-request-id: req-e034f8d8-b44c-40a4-a423-a75ae1873dc0 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:00.420164 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5a60575a-1a5f-4803-a19e-47821edba597", "name": "network-vif-deleted", "tag": "cf81a6f4-3d88-4d0e-b9d2-b79c61aea820", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:00.420422 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-e034f8d8-b44c-40a4-a423-a75ae1873dc0 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:00.420833 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5a60575a-1a5f-4803-a19e-47821edba597', 'name': 'network-vif-deleted', 'tag': 'cf81a6f4-3d88-4d0e-b9d2-b79c61aea820', 'status': 'completed', 'code': 200} Nov 15 12:41:00.431810 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6b4d70f1-bf92-4686-9964-14a263b72dc8 req-70efc690-26d6-4a01-ae41-569543d4e712 tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.0461926 Nov 15 12:41:00.506437 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9e843abc-71ca-433a-a92b-f035c2503fb4 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:41:00.601585 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 9e843abc-71ca-433a-a92b-f035c2503fb4 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:41:00.614483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 9e843abc-71ca-433a-a92b-f035c2503fb4 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:41:00.615163 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.765575 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.807262 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:00.809844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d1a386b-fdff-40f0-bb3a-55dda81faa6a" -d '{"events": [{"server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "name": "network-vif-plugged", "status": "completed", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:00.824979 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9e843abc-71ca-433a-a92b-f035c2503fb4,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:00.830652 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:00.931596 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6d12d37-64b8-4870-af67-c7ffe0e067cf x-openstack-request-id: req-e6d12d37-64b8-4870-af67-c7ffe0e067cf {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:00.932675 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "name": "network-vif-plugged", "status": "completed", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:00.932675 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-e6d12d37-64b8-4870-af67-c7ffe0e067cf {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:00.932675 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4', 'code': 200} Nov 15 12:41:00.938017 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:01.017938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa151783-df9f-4585-851f-c1a2666c6a9f req-dea0f336-954f-4081-b5fa-bd7ca4a311ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:01.026353 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fa151783-df9f-4585-851f-c1a2666c6a9f req-dea0f336-954f-4081-b5fa-bd7ca4a311ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0950046 Nov 15 12:41:01.120192 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fa151783-df9f-4585-851f-c1a2666c6a9f req-99e071a6-9928-41bb-a8ad-0452c3fdc295 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855329 Nov 15 12:41:01.452573 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dab13c6-ed60-4960-97c8-74f9c06b4756 req-5458f9e7-ee6b-44b5-a2b3-e6fcead9284c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:01.455155 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2dab13c6-ed60-4960-97c8-74f9c06b4756 req-5458f9e7-ee6b-44b5-a2b3-e6fcead9284c service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 1098 time: 0.1375291 Nov 15 12:41:01.497971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a696339-6b17-41f9-824f-b53515620aa3 req-38dd9167-4971-4b1e-a727-1dbf546430ce tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:01.506610 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7a696339-6b17-41f9-824f-b53515620aa3 req-38dd9167-4971-4b1e-a727-1dbf546430ce tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0738268 Nov 15 12:41:01.545661 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f24c57-2991-4ce6-9664-8f098508ea50 req-a4e71615-95fb-4982-904c-607137a0c7cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:01.548360 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a2f24c57-2991-4ce6-9664-8f098508ea50 req-a4e71615-95fb-4982-904c-607137a0c7cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1489804 Nov 15 12:41:01.589717 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2dab13c6-ed60-4960-97c8-74f9c06b4756 req-32669068-5e8f-4c06-8ce7-23f3a742c22a service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157844 Nov 15 12:41:01.609110 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7a696339-6b17-41f9-824f-b53515620aa3 req-1d560252-b0dc-42cd-88e2-c1698cadba83 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011961 Nov 15 12:41:01.668498 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a2f24c57-2991-4ce6-9664-8f098508ea50 req-0895868b-6109-4e9e-a375-fedf0664c535 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042957 Nov 15 12:41:01.808203 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9740faff-e6fa-462a-b576-8c6bb3e2a888 req-8b318e3b-2440-48b7-a61e-f2ea49e4eabe tempest-DeleteServersTestJSON-1942226444 tempest-DeleteServersTestJSON-1942226444-project] 10.222.0.44 "GET /v2.0/ports?device_id=5a60575a-1a5f-4803-a19e-47821edba597 HTTP/1.1" status: 200 len: 210 time: 0.0281332 Nov 15 12:41:02.302532 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e0a0b5-ca35-49c5-87bd-dc43824fa8b4 req-a7b50add-e9d0-4f8d-834d-ca56449a424a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:02.304474 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-56e0a0b5-ca35-49c5-87bd-dc43824fa8b4 req-a7b50add-e9d0-4f8d-834d-ca56449a424a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0837023 Nov 15 12:41:02.370745 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-56e0a0b5-ca35-49c5-87bd-dc43824fa8b4 req-645bc719-3499-40a0-9081-ca354607eeb7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515590 Nov 15 12:41:02.510520 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:41:02.553085 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:41:02.553445 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device cf81a6f4-3d88-4d0e-b9d2-b79c61aea820 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:41:02.822443 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8854c9df-de6f-4408-ad13-78c5d8c7871a req-6d144251-912d-429b-b277-2675c7e97f74 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:02.825142 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8854c9df-de6f-4408-ad13-78c5d8c7871a req-6d144251-912d-429b-b277-2675c7e97f74 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0812397 Nov 15 12:41:02.891438 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbffa8f-507d-4394-95c2-097625422578 req-ebdb17a6-0693-4421-a164-4ce3adbabce8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:02.893788 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ffbffa8f-507d-4394-95c2-097625422578 req-ebdb17a6-0693-4421-a164-4ce3adbabce8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0813160 Nov 15 12:41:02.902739 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8854c9df-de6f-4408-ad13-78c5d8c7871a req-c02a30e6-bbf7-41f7-8efa-7e2f5327a506 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656893 Nov 15 12:41:02.978426 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ffbffa8f-507d-4394-95c2-097625422578 req-16b01485-cafc-4159-8861-a5a70a73109d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768709 Nov 15 12:41:03.340772 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a2f0058f-2626-411f-9fb5-3b30cc5915a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:03.524853 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b20b8b7-64a1-455c-9694-d7b08ab41681 req-dce806be-da2c-48ad-934b-2bdd29310fa4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:03.527003 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b20b8b7-64a1-455c-9694-d7b08ab41681 req-dce806be-da2c-48ad-934b-2bdd29310fa4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0551023 Nov 15 12:41:03.592091 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b20b8b7-64a1-455c-9694-d7b08ab41681 req-6d014dfc-4ff9-450f-ab3a-defbb6d5f858 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540535 Nov 15 12:41:04.097581 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e39ef90-27b0-452d-aad3-e54d216153e6 req-798bf529-b612-4f52-8390-14534e098814 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:04.109540 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e39ef90-27b0-452d-aad3-e54d216153e6 req-798bf529-b612-4f52-8390-14534e098814 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.0987513 Nov 15 12:41:04.179756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-307a5464-4df5-4f37-9749-e3ea10a479fe tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:04.182018 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-307a5464-4df5-4f37-9749-e3ea10a479fe tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.61 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 949 time: 0.1308274 Nov 15 12:41:04.192111 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e39ef90-27b0-452d-aad3-e54d216153e6 req-454cdc8e-c425-45c3-a454-ae7c5870511b tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/security-groups?id=b3db8bb1-ff17-44c7-9690-5896c522cc86&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811787 Nov 15 12:41:04.203499 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4738070-b1aa-4d4e-895a-10b8c70131c2 req-afc37c71-7069-4bcb-b795-7dbba1701832 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:04.205670 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c4738070-b1aa-4d4e-895a-10b8c70131c2 req-afc37c71-7069-4bcb-b795-7dbba1701832 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1031818 Nov 15 12:41:04.339334 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c4738070-b1aa-4d4e-895a-10b8c70131c2 req-a28b32ef-19ff-4311-9545-fb9d9c5ce8aa tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240692 Nov 15 12:41:04.379897 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Deleting port 5a7e144f-2d8f-437e-a8f0-304ee7a644af {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:41:04.380465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:04.550365 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] For port 5a7e144f-2d8f-437e-a8f0-304ee7a644af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5a7e144f-2d8f-437e-a8f0-304ee7a644af,segment=NetworkSegment(43629f4a-6f55-4bf8-a7d1-29c54ac0908c),segment_id=43629f4a-6f55-4bf8-a7d1-29c54ac0908c)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:04.550974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:04.573549 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Calling delete_port for 5a7e144f-2d8f-437e-a8f0-304ee7a644af owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:41:04.823570 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d677d540-602a-452b-99f5-6a206757af97 req-9af17243-dfb3-4ac2-88f8-6b1d817756b6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:04.826256 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d677d540-602a-452b-99f5-6a206757af97 req-9af17243-dfb3-4ac2-88f8-6b1d817756b6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1157451 Nov 15 12:41:04.828163 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:04.870988 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Pushing event deleted for resources: {'Port': ['ID=5a7e144f-2d8f-437e-a8f0-304ee7a644af,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:04.888500 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['5a7e144f-2d8f-437e-a8f0-304ee7a644af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:41:04.934209 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d677d540-602a-452b-99f5-6a206757af97 req-375a5bb8-8b3d-4f06-84c3-3c6037338d97 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888531 Nov 15 12:41:04.980960 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] No DVR routers for this DVR port 5a7e144f-2d8f-437e-a8f0-304ee7a644af on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:41:04.986972 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:04.992956 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6d7dffa-3b7e-4f41-807f-220af87d35ce req-5e375b25-0129-400e-b862-a7b44fb39f09 tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.61 "DELETE /v2.0/ports/5a7e144f-2d8f-437e-a8f0-304ee7a644af HTTP/1.1" status: 204 len: 173 time: 0.7675040 Nov 15 12:41:04.993632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'name': 'network-vif-deleted', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:04.997539 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8faff85-2951-4845-895b-7707f5710e15" -d '{"events": [{"server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "name": "network-vif-deleted", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:05.093191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb1a8ff4-fb0e-405e-8f7e-079f39b2dfaf x-openstack-request-id: req-cb1a8ff4-fb0e-405e-8f7e-079f39b2dfaf {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:05.093577 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fc82d8fa-b560-4339-9a61-366d7da79a58", "name": "network-vif-deleted", "tag": "5a7e144f-2d8f-437e-a8f0-304ee7a644af", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:05.093839 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-cb1a8ff4-fb0e-405e-8f7e-079f39b2dfaf {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:05.094249 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc82d8fa-b560-4339-9a61-366d7da79a58', 'name': 'network-vif-deleted', 'tag': '5a7e144f-2d8f-437e-a8f0-304ee7a644af', 'status': 'completed', 'code': 200} Nov 15 12:41:05.383216 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab47b981-c597-4940-9f90-3e5b3b13439a req-24ac09bc-4e94-489f-a0a6-0f42d3a23b0f tempest-VolumesNegativeTest-2089569960 tempest-VolumesNegativeTest-2089569960-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc82d8fa-b560-4339-9a61-366d7da79a58 HTTP/1.1" status: 200 len: 210 time: 0.0415292 Nov 15 12:41:05.520738 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e7fe06-b2c1-402a-9c6c-eefa294b9515 req-aa9d6798-1ebb-4e7c-9295-fe8200968dfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:05.522088 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4e7fe06-b2c1-402a-9c6c-eefa294b9515 req-aa9d6798-1ebb-4e7c-9295-fe8200968dfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0831971 Nov 15 12:41:05.616174 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4e7fe06-b2c1-402a-9c6c-eefa294b9515 req-40f327e5-a238-4ce3-ae8f-b37528e5605f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796564 Nov 15 12:41:05.697030 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49462) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:05.745750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a3cef60a-20cc-4825-847e-d7699579cd14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:05.778632 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Deleting subnet d52c5911-a606-4287-aa04-2d2021b05259 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:41:05.782650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:05.831570 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:05.938631 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:05.989557 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49478) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:06.049637 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.103024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.113838 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/d52c5911-a606-4287-aa04-2d2021b05259 HTTP/1.1" status: 204 len: 168 time: 0.4150929 Nov 15 12:41:06.114049 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49484) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:06.115905 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a58945-172b-4b1f-b456-5755b6eae8c1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d52c5911-a606-4287-aa04-2d2021b05259,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:06.278898 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b96b5918-8111-4bb0-a5b4-3d9c794ddf35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.352738 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efd1eea-ad4e-41b1-899e-4c78f0c18a8a req-956d38ec-bfbc-4c23-964c-7de5ccbfdcd1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:06.355581 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8efd1eea-ad4e-41b1-899e-4c78f0c18a8a req-956d38ec-bfbc-4c23-964c-7de5ccbfdcd1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.2199540 Nov 15 12:41:06.359756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.559672 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8efd1eea-ad4e-41b1-899e-4c78f0c18a8a req-6b5b0af0-0476-4915-8268-c65e8c30aa31 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1912444 Nov 15 12:41:06.658539 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.724196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3102b790-5ced-465f-afa4-ed5c98c0e5d0']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:41:06.724541 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b96b5918-8111-4bb0-a5b4-3d9c794ddf35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.744874 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b96b5918-8111-4bb0-a5b4-3d9c794ddf35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.755092 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42712e6e-6181-4ceb-bdda-98824d122256') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:41:06.755468 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42712e6e-6181-4ceb-bdda-98824d122256') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:41:06.790456 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.846718 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b96b5918-8111-4bb0-a5b4-3d9c794ddf35 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=3e455e2b32704ccb95d070b613e2efdc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8550630 Nov 15 12:41:06.848930 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.850318 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49508) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:06.852635 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96b5918-8111-4bb0-a5b4-3d9c794ddf35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc812016-9c38-40e9-aa6b-4cae1f2876f5,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:06.858926 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.870811 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Releasing vlan 642 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:41:06.872949 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:41:06.879545 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:41:06.967799 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.009390 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.024177 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.042855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49524) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:07.049770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.057202 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] 10.222.0.44 "DELETE /v2.0/networks/3102b790-5ced-465f-afa4-ed5c98c0e5d0 HTTP/1.1" status: 204 len: 168 time: 0.9378841 Nov 15 12:41:07.057202 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-714ae90b-4f5e-4319-88c1-cd6d9396ebc6 admin admin] Pushing event deleted for resources: {'Network': ['ID=3102b790-5ced-465f-afa4-ed5c98c0e5d0,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:07.084997 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.087836 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.089371 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/dc812016-9c38-40e9-aa6b-4cae1f2876f5 HTTP/1.1" status: 204 len: 168 time: 0.2365527 Nov 15 12:41:07.099861 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e407df2-a3f1-43f0-9717-be08a516d1b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc812016-9c38-40e9-aa6b-4cae1f2876f5,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:07.258555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c566d61-a501-4188-bfed-a7814ef6a5c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.414157 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c566d61-a501-4188-bfed-a7814ef6a5c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.421466 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8c566d61-a501-4188-bfed-a7814ef6a5c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.499368 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49546) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:07.577223 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8c566d61-a501-4188-bfed-a7814ef6a5c3 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=f131b5d443d647bf987f3cd9f42984e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5330296 Nov 15 12:41:07.581018 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49552) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:07.583861 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-50d2ca90-1cc2-425e-976a-3b8b5f9c29b5 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=9273dacda2824318a7e6d2acf9f295ba&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0822968 Nov 15 12:41:07.584664 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49554) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:07.629984 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c566d61-a501-4188-bfed-a7814ef6a5c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bd54a5a-b11c-4fcd-9463-f21fa8870773,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:07.709534 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.750873 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.806449 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.826340 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.829835 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.832457 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/3d568b54-8b67-4b41-939c-80772461a0cc HTTP/1.1" status: 204 len: 168 time: 0.2463613 Nov 15 12:41:07.843243 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:07.849741 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9432b84c-7b75-463a-b940-90f6e14ca61c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d568b54-8b67-4b41-939c-80772461a0cc,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:07.875362 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24e3a15-1df7-4655-896a-30212785fe58 req-47b9ff16-d32c-4097-8ee7-2f398dcb3683 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:07.878544 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a24e3a15-1df7-4655-896a-30212785fe58 req-47b9ff16-d32c-4097-8ee7-2f398dcb3683 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1354620 Nov 15 12:41:07.983344 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 49598) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:08.022140 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a24e3a15-1df7-4655-896a-30212785fe58 req-15842cd4-b2c6-43c6-9ed9-8e613b0c487d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1180270 Nov 15 12:41:08.032265 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.037831 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.042596 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/4bd54a5a-b11c-4fcd-9463-f21fa8870773 HTTP/1.1" status: 204 len: 168 time: 0.4308379 Nov 15 12:41:08.042800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-57da6e5f-b798-402a-90de-6d1918dbfed8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.055853 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7926564c-222a-41d5-a570-f787e79c78de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bd54a5a-b11c-4fcd-9463-f21fa8870773,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:08.288277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-57da6e5f-b798-402a-90de-6d1918dbfed8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.293710 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-57da6e5f-b798-402a-90de-6d1918dbfed8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.361055 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.362376 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49620) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:08.375347 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-57da6e5f-b798-402a-90de-6d1918dbfed8 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=61017294ccc74ca3915b9c3b0d527547&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3862090 Nov 15 12:41:08.379379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57da6e5f-b798-402a-90de-6d1918dbfed8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6054dcac-1f66-4fd7-b5d5-8a5a5507704b,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:08.481617 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.522598 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5a7e144f-2d8f-437e-a8f0-304ee7a644af no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:41:08.530065 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.560397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 5a7e144f-2d8f-437e-a8f0-304ee7a644af {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:41:08.561520 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5a7e144f-2d8f-437e-a8f0-304ee7a644af not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:41:08.630366 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.633986 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:08.635304 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6054dcac-1f66-4fd7-b5d5-8a5a5507704b HTTP/1.1" status: 204 len: 168 time: 0.2714524 Nov 15 12:41:08.645285 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036fc316-831b-425a-9f00-5dbd635d21be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6054dcac-1f66-4fd7-b5d5-8a5a5507704b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:09.141963 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:09.227800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7348d647-2c81-4510-991f-129bc21b4ba4 req-3579d669-eaec-478c-85e7-e68bc183b768 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:09.231158 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7348d647-2c81-4510-991f-129bc21b4ba4 req-3579d669-eaec-478c-85e7-e68bc183b768 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0891271 Nov 15 12:41:09.339650 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7348d647-2c81-4510-991f-129bc21b4ba4 req-59bd6415-de85-4b42-bb55-ffdd02934eb8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974274 Nov 15 12:41:09.741237 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-64d02ec3-5858-44b6-8afa-3c330a6d412f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:09.743415 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-64d02ec3-5858-44b6-8afa-3c330a6d412f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.2088115 Nov 15 12:41:09.778306 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-beb8d8b9-10b2-4005-a201-cbf8f4e0a3fa tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/quotas/27402858adce449996a04024b968bae3 HTTP/1.1" status: 200 len: 375 time: 0.0224009 Nov 15 12:41:09.880852 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-7149f659-bb80-42d7-8a26-8f5a702811a1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0796914 Nov 15 12:41:10.004152 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-c20fd7f0-bf23-41f1-a362-fe7e1e9aae24 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1219535 Nov 15 12:41:10.158318 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5a930b2b-fc03-4641-9117-96b6c748b7b5 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1436865 Nov 15 12:41:10.469499 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3e99cd99-67cc-454c-803f-ed91db1e357b req-a2093025-41fb-48fd-8c09-1019d2c6cacf tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 210 time: 0.0548179 Nov 15 12:41:10.616089 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c9a99f-d91f-4ced-bedb-5b5240823cbe req-7dbb4bc1-fe18-4744-8183-a616a49d59bc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:10.627126 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37c9a99f-d91f-4ced-bedb-5b5240823cbe req-7dbb4bc1-fe18-4744-8183-a616a49d59bc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1114190 Nov 15 12:41:10.716249 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37c9a99f-d91f-4ced-bedb-5b5240823cbe req-689134d4-6a69-4234-9d3e-2e7089482e3f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878444 Nov 15 12:41:11.678317 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a2ad5142-19af-4480-a353-61740e074d69 req-c7725f25-ad47-4cb7-9fce-87d65d9ccd32 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 210 time: 0.0585794 Nov 15 12:41:11.993666 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b94341-fcb0-4ea3-8b8b-4eb511a25d6e req-d9265d46-63ee-4ad3-aa0c-a194371fe5b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:12.009845 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-25b94341-fcb0-4ea3-8b8b-4eb511a25d6e req-d9265d46-63ee-4ad3-aa0c-a194371fe5b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1475508 Nov 15 12:41:12.117712 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:12.128693 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-25b94341-fcb0-4ea3-8b8b-4eb511a25d6e req-75836fd9-b93e-45dc-8e38-8832105278b3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211085 Nov 15 12:41:12.872457 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-0ee7635a-ede3-4451-9f0d-c532f2ebff7a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:12.875280 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-0ee7635a-ede3-4451-9f0d-c532f2ebff7a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.2584245 Nov 15 12:41:12.926177 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-16a8ece3-bf07-465d-9db9-bf3d73f9c8c0 req-32b36ae5-5a1d-4fca-8b1c-c48abd1df302 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 210 time: 0.0495119 Nov 15 12:41:12.931181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Request body: {'port': {'device_id': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'admin_state_up': True, 'tenant_id': '27402858adce449996a04024b968bae3'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:13.056671 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49916) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:13.136331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:13.143541 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.318600 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-855b136c-ec5a-46e5-832f-2fd3d1d30c7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.420836 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Allocated IP 172.20.0.3 (e836cde6-4e01-43bc-9750-09587b9bb5d0/65d6a75d-c74e-4d29-a0f1-5b5b6db06715/a106f2a9-c144-4b28-9287-b71a667e6786) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:41:13.488405 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32507236-1d06-4a5b-9061-1f896388e83e req-4ce7b876-cd16-44e4-9385-24d1723854f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:13.493137 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-32507236-1d06-4a5b-9061-1f896388e83e req-4ce7b876-cd16-44e4-9385-24d1723854f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1082685 Nov 15 12:41:13.595024 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-32507236-1d06-4a5b-9061-1f896388e83e req-20774cd0-88f1-487a-ac26-3c278da3ee89 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771756 Nov 15 12:41:13.616416 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-855b136c-ec5a-46e5-832f-2fd3d1d30c7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.629329 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-855b136c-ec5a-46e5-832f-2fd3d1d30c7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.692491 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-855b136c-ec5a-46e5-832f-2fd3d1d30c7b admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=2d39de37f4194f7eae07740f609da96f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6340783 Nov 15 12:41:13.696534 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 49966) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:13.709623 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855b136c-ec5a-46e5-832f-2fd3d1d30c7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2fa429b-e648-4384-bca4-b82faaa2bf71,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:13.778321 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.795892 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.832788 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.868440 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.887518 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:41:13.892970 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:13.900026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:41:13.946755 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event updated for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:13.951327 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.955849 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:13.958262 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/c2fa429b-e648-4384-bca4-b82faaa2bf71 HTTP/1.1" status: 204 len: 168 time: 0.2595181 Nov 15 12:41:13.970424 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd04b72-feb3-4f09-a916-8419d79158d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2fa429b-e648-4384-bca4-b82faaa2bf71,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:13.996694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:13.997371 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.027277 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-16f507d9-b7a5-4c1d-acfb-181806e01e6f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1052215 Nov 15 12:41:14.136791 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3a2660-9464-4f72-9c3e-4ef1d682ccb9 req-af7e9622-929d-46de-8217-9410b12095f2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:14.138575 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9b3a2660-9464-4f72-9c3e-4ef1d682ccb9 req-af7e9622-929d-46de-8217-9410b12095f2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 931 time: 0.0694051 Nov 15 12:41:14.223705 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9b3a2660-9464-4f72-9c3e-4ef1d682ccb9 req-67ac26e4-d364-4496-a901-f11989826892 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753975 Nov 15 12:41:14.432933 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50000) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:14.449174 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-263553b9-e0d8-44b4-b4eb-2faaa6ec43c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.503271 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50002) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:14.557106 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-263553b9-e0d8-44b4-b4eb-2faaa6ec43c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.562067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-263553b9-e0d8-44b4-b4eb-2faaa6ec43c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.777102 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1031a9-862b-4362-83af-d7e3369e47af req-61711c47-d62a-4f49-adb9-2951afe733bc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:14.778585 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-da1031a9-862b-4362-83af-d7e3369e47af req-61711c47-d62a-4f49-adb9-2951afe733bc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0626352 Nov 15 12:41:14.854908 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-da1031a9-862b-4362-83af-d7e3369e47af req-6688d849-cb48-42b7-99e6-0e2b8355af56 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649176 Nov 15 12:41:14.879791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263553b9-e0d8-44b4-b4eb-2faaa6ec43c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ace1137-cfc3-43ac-9340-dafd23969d46,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:14.890378 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-263553b9-e0d8-44b4-b4eb-2faaa6ec43c4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=f8dce536a46e4c8f9d206889932776df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4529305 Nov 15 12:41:14.890378 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c9340d57-a2be-4860-a1e2-c9f5c8a38e99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.891475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50010) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:14.964212 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:14.996623 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.010032 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c9340d57-a2be-4860-a1e2-c9f5c8a38e99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.015842 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c9340d57-a2be-4860-a1e2-c9f5c8a38e99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.074252 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.077252 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c9340d57-a2be-4860-a1e2-c9f5c8a38e99 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=72dca1a2407d41719b61cc4a79c7e513&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5718539 Nov 15 12:41:15.077450 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.078507 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9340d57-a2be-4860-a1e2-c9f5c8a38e99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48988221-a6b8-4d90-85c1-b9a167025bcc,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:15.082075 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50014) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:15.086426 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/9ace1137-cfc3-43ac-9340-dafd23969d46 HTTP/1.1" status: 204 len: 168 time: 0.1916273 Nov 15 12:41:15.099323 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3062a6-631c-4d52-96f1-c1d78781e7a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ace1137-cfc3-43ac-9340-dafd23969d46,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:15.165703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.193304 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.249985 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.254847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.259754 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/48988221-a6b8-4d90-85c1-b9a167025bcc HTTP/1.1" status: 204 len: 168 time: 0.1758978 Nov 15 12:41:15.269081 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d351538a-afd3-40c6-945b-79fac4e2ecfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48988221-a6b8-4d90-85c1-b9a167025bcc,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:15.422021 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff62a2e0-2429-4c19-8b6e-ffe79b7c6cfe req-1004714c-131d-4c98-a9f6-c5a72bd0d04e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:15.428747 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff62a2e0-2429-4c19-8b6e-ffe79b7c6cfe req-1004714c-131d-4c98-a9f6-c5a72bd0d04e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 931 time: 0.0796549 Nov 15 12:41:15.479829 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff62a2e0-2429-4c19-8b6e-ffe79b7c6cfe req-dbcb72a8-04ae-4c23-a072-3b38c7db4dfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477176 Nov 15 12:41:15.755395 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50036) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:15.770313 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7dacf1fe-ab6e-4229-b729-8467b6ed59ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.891069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7dacf1fe-ab6e-4229-b729-8467b6ed59ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.897992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7dacf1fe-ab6e-4229-b729-8467b6ed59ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:15.941461 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-7dacf1fe-ab6e-4229-b729-8467b6ed59ed admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=c9aea22e1bcb4b268028b8fd70e359c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1804397 Nov 15 12:41:15.941676 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50044) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:15.963044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dacf1fe-ab6e-4229-b729-8467b6ed59ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e87d7a2d-3602-4b13-bf1e-3df29472827e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:16.092728 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f03b02-ae68-4d54-b6b3-37944d48f562 req-e1ccf674-5a09-4e0d-b84b-c466c8a3aa0d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:16.094256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-01f03b02-ae68-4d54-b6b3-37944d48f562 req-e1ccf674-5a09-4e0d-b84b-c466c8a3aa0d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0929036 Nov 15 12:41:16.095115 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:16.132599 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:16.206297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-01f03b02-ae68-4d54-b6b3-37944d48f562 req-fb12951c-094c-4d46-b798-6a6211052693 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990863 Nov 15 12:41:16.251436 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:16.254912 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:16.256338 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e87d7a2d-3602-4b13-bf1e-3df29472827e HTTP/1.1" status: 204 len: 168 time: 0.3132656 Nov 15 12:41:16.269879 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c4b6e3-458c-497c-ae23-db783d9d2c0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e87d7a2d-3602-4b13-bf1e-3df29472827e,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:16.661772 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162cff38-1890-429f-a6de-ed0078b77392 req-f7b41356-17a8-482a-b871-9de04072d4d0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:16.663428 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-162cff38-1890-429f-a6de-ed0078b77392 req-f7b41356-17a8-482a-b871-9de04072d4d0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 931 time: 0.0751610 Nov 15 12:41:16.771456 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-162cff38-1890-429f-a6de-ed0078b77392 req-e1c85e76-bc88-448f-b965-f58576ab2abf tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986173 Nov 15 12:41:17.070170 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670', '9e843abc-71ca-433a-a92b-f035c2503fb4'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:41:17.082406 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Request body: {'port': {'device_id': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:17.235462 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:17.413936 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4e9715-17e6-4021-9e48-93a3ab8c933f req-ab91de24-b265-4385-8daa-c1ee77780874 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:17.434824 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca4e9715-17e6-4021-9e48-93a3ab8c933f req-ab91de24-b265-4385-8daa-c1ee77780874 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1124630 Nov 15 12:41:17.554329 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ca4e9715-17e6-4021-9e48-93a3ab8c933f req-5ed5a61f-3f2a-466d-a76a-9546854ab73a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179795 Nov 15 12:41:17.758618 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a106f2a9-c144-4b28-9287-b71a667e6786 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:41:17.772783 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:17.796880 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Transition to ACTIVE for port object a106f2a9-c144-4b28-9287-b71a667e6786 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:41:17.813558 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:17.948168 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Pushing event updated for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:18.073012 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fec2ea-76e9-4025-adf1-91744488d845 req-5c097689-f49e-4d52-9845-d5da6ab624f4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:18.073012 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-61fec2ea-76e9-4025-adf1-91744488d845 req-5c097689-f49e-4d52-9845-d5da6ab624f4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.1732917 Nov 15 12:41:18.233538 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-61fec2ea-76e9-4025-adf1-91744488d845 req-df6652c3-ffc3-4495-83e7-fca0a05f7d2b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1539292 Nov 15 12:41:18.235809 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Attempting to bind port a106f2a9-c144-4b28-9287-b71a667e6786 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:41:18.236374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Attempting to bind port a106f2a9-c144-4b28-9287-b71a667e6786 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:41:18.236896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Attempting to bind port a106f2a9-c144-4b28-9287-b71a667e6786 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:18.248474 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Port a106f2a9-c144-4b28-9287-b71a667e6786 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:41:18.248795 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Attempting to bind port a106f2a9-c144-4b28-9287-b71a667e6786 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:18.259581 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 41, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:41:18.263568 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Checking segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:18.264067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Bound using segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:41:18.264574 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Bound port: a106f2a9-c144-4b28-9287-b71a667e6786, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:41:18.264941 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:18.394009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:41:18.400781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=a106f2a9-c144-4b28-9287-b71a667e6786,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:41:18.410247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:18.455192 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:18.456678 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:18.458935 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] 10.222.0.61 "PUT /v2.0/ports/a106f2a9-c144-4b28-9287-b71a667e6786 HTTP/1.1" status: 200 len: 1093 time: 1.3877347 Nov 15 12:41:18.461932 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:18.464607 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35f55c02-c6e7-4d85-b861-09ba9e00db27" -d '{"events": [{"name": "network-changed", "server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:18.522289 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c24edd5-cf1b-4939-b1ea-b56d5bae7b2e service neutron] Pushing event updated for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:18.569014 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7331b39e-9f9f-4384-a9f4-46a3f38cf854 x-openstack-request-id: req-7331b39e-9f9f-4384-a9f4-46a3f38cf854 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:18.569490 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:18.569760 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-7331b39e-9f9f-4384-a9f4-46a3f38cf854 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:18.570257 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786', 'status': 'completed', 'code': 200} Nov 15 12:41:18.753651 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-8ab9f6e2-2487-401c-97a6-f5ee67d86fa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:18.756634 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-8ab9f6e2-2487-401c-97a6-f5ee67d86fa8 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 1096 time: 0.1201081 Nov 15 12:41:18.764424 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a95b759f-7901-457e-ac6f-7a7491ebdbc7 req-37dbc7a8-b229-4625-9351-774b6c7683aa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:18.774968 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a95b759f-7901-457e-ac6f-7a7491ebdbc7 req-37dbc7a8-b229-4625-9351-774b6c7683aa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0882621 Nov 15 12:41:18.853355 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a95b759f-7901-457e-ac6f-7a7491ebdbc7 req-ae6e19d6-57e9-47bc-9cff-285f69fce8cb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768218 Nov 15 12:41:18.883716 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-1ff2f34f-f35e-4117-b94d-15c8852d8c2b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a106f2a9-c144-4b28-9287-b71a667e6786 HTTP/1.1" status: 200 len: 217 time: 0.1004322 Nov 15 12:41:18.943482 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50148) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:18.983965 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-8e105b3f-7991-4efa-a974-dd8941817fa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:18.986450 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-8e105b3f-7991-4efa-a974-dd8941817fa7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.0719326 Nov 15 12:41:19.127831 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ec3e0e6a-dba2-431c-be54-01754c353678 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=062c8474a5e24cbda37ef168fe1cc426&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1831353 Nov 15 12:41:19.132969 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50156) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:19.188839 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:19.250401 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:19.325698 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:19.328672 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:19.332446 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/b3db8bb1-ff17-44c7-9690-5896c522cc86 HTTP/1.1" status: 204 len: 168 time: 0.1961064 Nov 15 12:41:19.339516 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b812927-d4b0-45b1-bc2c-630d03e75b3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3db8bb1-ff17-44c7-9690-5896c522cc86,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:19.455212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb0c0c4-e5da-417b-aa56-7a4316b66023 req-b8c7d48f-4684-4869-9d42-8349f84c4347 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:19.457722 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bfb0c0c4-e5da-417b-aa56-7a4316b66023 req-b8c7d48f-4684-4869-9d42-8349f84c4347 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.1103051 Nov 15 12:41:19.535638 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bfb0c0c4-e5da-417b-aa56-7a4316b66023 req-fcb16a7c-cea4-4f93-a809-55e8c2a62fc4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698180 Nov 15 12:41:20.016888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12a373d-50e8-4e5f-915e-7ce26e4a5085 req-d3f28375-13f0-4c29-9b5b-8d52fa522790 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:20.019964 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b12a373d-50e8-4e5f-915e-7ce26e4a5085 req-d3f28375-13f0-4c29-9b5b-8d52fa522790 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0620201 Nov 15 12:41:20.084225 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b12a373d-50e8-4e5f-915e-7ce26e4a5085 req-dc182b13-441f-4afe-bd2e-2945860e7c1e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511637 Nov 15 12:41:20.239474 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-f39c600d-d61c-4e8b-873b-79996ff2c47f service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0301423 Nov 15 12:41:20.687988 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8e6a3a-5782-4d39-bf4d-6d691e650a34 req-6a76eeb3-e72a-40d3-8bfb-885ec97d692c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:20.689572 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5f8e6a3a-5782-4d39-bf4d-6d691e650a34 req-6a76eeb3-e72a-40d3-8bfb-885ec97d692c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.0645158 Nov 15 12:41:20.770534 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5f8e6a3a-5782-4d39-bf4d-6d691e650a34 req-b70dbe76-d860-4c42-b604-43ba75986d55 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721881 Nov 15 12:41:21.238166 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649391ee-1b1d-4b25-922e-dfcd68e83678 req-2f3b26b0-3348-4af7-81f5-b1dff7b68844 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:21.239673 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-649391ee-1b1d-4b25-922e-dfcd68e83678 req-2f3b26b0-3348-4af7-81f5-b1dff7b68844 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0560918 Nov 15 12:41:21.295661 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-649391ee-1b1d-4b25-922e-dfcd68e83678 req-e44f4f37-dc87-43b7-8a30-e68dca31412d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498173 Nov 15 12:41:21.891220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cbf1f2-10d3-4b62-ac79-d3e1b109df17 req-07ea4e3f-46c2-4c5c-b385-36ce37625421 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:21.892812 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-40cbf1f2-10d3-4b62-ac79-d3e1b109df17 req-07ea4e3f-46c2-4c5c-b385-36ce37625421 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.0524580 Nov 15 12:41:21.954759 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-40cbf1f2-10d3-4b62-ac79-d3e1b109df17 req-7defed57-b801-49bb-9c6f-984b2a5465c8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543873 Nov 15 12:41:22.307832 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-9b7fa347-a329-478f-ad58-7c703baee346 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1138744 Nov 15 12:41:22.453650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b30afbb-cf3c-4c03-acb7-121ab3e4cdfd req-b8cb11cd-ce39-47ba-a723-47092c10069b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:22.455309 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6b30afbb-cf3c-4c03-acb7-121ab3e4cdfd req-b8cb11cd-ce39-47ba-a723-47092c10069b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0795984 Nov 15 12:41:22.458363 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1d5c253c-3711-41cf-8e56-e578c3b3940f req-c91a60c4-2690-4c52-ad32-d2b229098363 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1344287 Nov 15 12:41:22.536385 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6b30afbb-cf3c-4c03-acb7-121ab3e4cdfd req-ce1570b2-ea57-46da-954e-e39051cac96c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742130 Nov 15 12:41:22.672729 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-32d3dd4d-c581-44fe-a4c0-12f9f4063a13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:22.675399 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-32d3dd4d-c581-44fe-a4c0-12f9f4063a13 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 1096 time: 0.0507841 Nov 15 12:41:22.836974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-72960f9a-0970-4549-a045-83bebb3101bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:22.843991 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-72960f9a-0970-4549-a045-83bebb3101bc service neutron] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 916 time: 0.1574707 Nov 15 12:41:22.929467 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-ae446441-e6b7-4fe4-8d87-74a96066ac31 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a106f2a9-c144-4b28-9287-b71a667e6786 HTTP/1.1" status: 200 len: 217 time: 0.0639067 Nov 15 12:41:23.016438 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-0a0aea63-85ef-4e87-a2f8-e46fd3ed15e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:23.018080 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-0a0aea63-85ef-4e87-a2f8-e46fd3ed15e8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.0798566 Nov 15 12:41:23.074550 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-df85eee8-da1e-4b11-ac48-a7632c2bfb7c service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0369880 Nov 15 12:41:23.135781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47dfa76c-dd12-4368-a1ae-3feba1e4caca req-8f3ded6b-f607-4780-9639-2046384cada2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:23.137451 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-47dfa76c-dd12-4368-a1ae-3feba1e4caca req-8f3ded6b-f607-4780-9639-2046384cada2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.0621738 Nov 15 12:41:23.188550 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-c0b3f3ee-07cd-47f5-b950-82188cc7a7a1 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0956779 Nov 15 12:41:23.201467 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-47dfa76c-dd12-4368-a1ae-3feba1e4caca req-86f6bd4c-f9c0-4892-9de1-4915f84e0df5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561304 Nov 15 12:41:23.337912 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-35f55c02-c6e7-4d85-b861-09ba9e00db27 req-c82f4c8e-df17-42e9-b16b-b5cba0ee4be2 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329162 Nov 15 12:41:23.690257 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1021ff3a-51c4-48f7-9b87-38af9043998c req-3f45e062-b7ab-4d70-9106-bd6fc70516d3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:23.692847 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1021ff3a-51c4-48f7-9b87-38af9043998c req-3f45e062-b7ab-4d70-9106-bd6fc70516d3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0714004 Nov 15 12:41:23.781867 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1021ff3a-51c4-48f7-9b87-38af9043998c req-06f894b3-8ae3-4f33-b3af-5ef22c64688f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797129 Nov 15 12:41:24.066750 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50260) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:24.214976 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ec913c0c-109b-492f-a96d-94e2a64d9ef2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.337673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ec913c0c-109b-492f-a96d-94e2a64d9ef2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.344512 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ec913c0c-109b-492f-a96d-94e2a64d9ef2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.390574 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ec913c0c-109b-492f-a96d-94e2a64d9ef2 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=c77f9763f3184c45be927c8a4635504e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3222265 Nov 15 12:41:24.393462 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec913c0c-109b-492f-a96d-94e2a64d9ef2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a16f90e6-ac30-4bee-a9b7-5296909b5f35,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:24.395292 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50272) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:24.422859 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50274) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:24.440418 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a463ae-0d09-4800-9308-d33d182e0dd5 req-560d7337-4ee7-4ea7-9a4d-14d65fae2321 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:24.442192 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1a463ae-0d09-4800-9308-d33d182e0dd5 req-560d7337-4ee7-4ea7-9a4d-14d65fae2321 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 943 time: 0.1070628 Nov 15 12:41:24.522304 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.559360 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1a463ae-0d09-4800-9308-d33d182e0dd5 req-173268d2-2ffb-4c97-a6e7-e04585a0a56e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1057763 Nov 15 12:41:24.570051 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.641129 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.643744 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.645581 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a16f90e6-ac30-4bee-a9b7-5296909b5f35 HTTP/1.1" status: 204 len: 168 time: 0.2490327 Nov 15 12:41:24.657990 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fec266e-beff-40b9-bd41-15b71acb8ec4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a16f90e6-ac30-4bee-a9b7-5296909b5f35,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:24.662090 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ad91e50f-e5fd-41ae-8699-d2f557db327d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.787471 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ad91e50f-e5fd-41ae-8699-d2f557db327d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.792783 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ad91e50f-e5fd-41ae-8699-d2f557db327d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:24.844516 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ad91e50f-e5fd-41ae-8699-d2f557db327d admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=0d3fe7a410d24eb6b725871486ac809b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4182162 Nov 15 12:41:24.844879 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad91e50f-e5fd-41ae-8699-d2f557db327d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=858defad-9668-4302-ac23-7a1048d4f499,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:24.845914 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50288) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:24.980243 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.014794 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207ac492-2471-41c8-9d03-9977525ebd5e req-565d9d4b-0978-47fd-9b7e-54eb6101843b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:25.016498 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-207ac492-2471-41c8-9d03-9977525ebd5e req-565d9d4b-0978-47fd-9b7e-54eb6101843b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1011233 Nov 15 12:41:25.018945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.099568 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-207ac492-2471-41c8-9d03-9977525ebd5e req-80a3fc16-a128-4690-a067-caa90231c43d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723300 Nov 15 12:41:25.104502 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50290) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:25.146163 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device a106f2a9-c144-4b28-9287-b71a667e6786 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:41:25.151595 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.156162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.158057 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/858defad-9668-4302-ac23-7a1048d4f499 HTTP/1.1" status: 204 len: 168 time: 0.3098567 Nov 15 12:41:25.162428 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6047a4d4-da0d-436e-9793-10598f7a6d65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.189205 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73534ca5-d180-409b-af40-f52d0262df38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=858defad-9668-4302-ac23-7a1048d4f499,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:25.314829 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6047a4d4-da0d-436e-9793-10598f7a6d65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.321452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6047a4d4-da0d-436e-9793-10598f7a6d65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.412531 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-6047a4d4-da0d-436e-9793-10598f7a6d65 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=bb7619127ab04756a155d6b4fc90b384&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3035028 Nov 15 12:41:25.412531 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6047a4d4-da0d-436e-9793-10598f7a6d65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a777dbf-0137-4320-92ac-021e5772d869,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:25.413282 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50302) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:25.460652 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=a106f2a9-c144-4b28-9287-b71a667e6786,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:25.478590 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'a106f2a9-c144-4b28-9287-b71a667e6786', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'port_id': 'a106f2a9-c144-4b28-9287-b71a667e6786', 'mac_address': 'fa:16:3e:23:61:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 647, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65d6a75d-c74e-4d29-a0f1-5b5b6db06715', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:41:25.544059 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.554744 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.564058 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a106f2a9-c144-4b28-9287-b71a667e6786 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:41:25.593256 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=a106f2a9-c144-4b28-9287-b71a667e6786,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:25.599947 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.609304 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.683839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:25.782134 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.788531 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.792763 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/4a777dbf-0137-4320-92ac-021e5772d869 HTTP/1.1" status: 204 len: 168 time: 0.3759437 Nov 15 12:41:25.811026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50318) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:25.840174 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-445c120e-95ef-499d-91de-ad529115c82f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a777dbf-0137-4320-92ac-021e5772d869,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:25.855780 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-470fa816-c5cf-4740-874d-4d55433c3000 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:25.928500 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-853174f4-0875-4d49-86db-b10c07f20cb3 req-e693b113-4761-44c1-9bbf-2d66be55ec7f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:25.931619 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-853174f4-0875-4d49-86db-b10c07f20cb3 req-e693b113-4761-44c1-9bbf-2d66be55ec7f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 944 time: 0.1183043 Nov 15 12:41:26.015389 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-853174f4-0875-4d49-86db-b10c07f20cb3 req-f7fa1aeb-620c-4c07-88fc-13c9368c067c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744300 Nov 15 12:41:26.036303 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-470fa816-c5cf-4740-874d-4d55433c3000 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.044229 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-470fa816-c5cf-4740-874d-4d55433c3000 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.096230 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-470fa816-c5cf-4740-874d-4d55433c3000 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=362485e131ef4cb5884c2b3276dc091e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2830441 Nov 15 12:41:26.097922 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470fa816-c5cf-4740-874d-4d55433c3000 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11080295-755b-42bf-93a3-b8fd8d349a46,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:26.100810 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50320) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:26.188747 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.209889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['a106f2a9-c144-4b28-9287-b71a667e6786'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:41:26.254932 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.283735 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf6e427-9f2a-4048-85c6-c9c057d2dad7 req-7430cd46-57d6-41dc-9f47-2c0b820ffdb9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:26.290240 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ecf6e427-9f2a-4048-85c6-c9c057d2dad7 req-7430cd46-57d6-41dc-9f47-2c0b820ffdb9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0993977 Nov 15 12:41:26.371971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.380247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:26.382177 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/11080295-755b-42bf-93a3-b8fd8d349a46 HTTP/1.1" status: 204 len: 168 time: 0.2801249 Nov 15 12:41:26.402650 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ecf6e427-9f2a-4048-85c6-c9c057d2dad7 req-d4c549bb-ac07-45a0-80ef-7c499aadd6d9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040013 Nov 15 12:41:26.418856 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76841a9b-172a-4f90-bd83-b85bd77aaff0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11080295-755b-42bf-93a3-b8fd8d349a46,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:27.269824 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d982256a-4324-4f7a-a5eb-2ea015bd27c3 req-15f0f925-27bd-4096-9ecd-477ecfeeab75 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:27.271406 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d982256a-4324-4f7a-a5eb-2ea015bd27c3 req-15f0f925-27bd-4096-9ecd-477ecfeeab75 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 944 time: 0.0876484 Nov 15 12:41:27.351910 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d982256a-4324-4f7a-a5eb-2ea015bd27c3 req-1247502c-a1ec-49af-a0c5-508d551531e7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736759 Nov 15 12:41:27.586386 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042eaca7-0d08-4be8-a356-43732d83b294 req-01b46730-bd63-45d8-b258-4c82aba77387 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:27.587958 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-042eaca7-0d08-4be8-a356-43732d83b294 req-01b46730-bd63-45d8-b258-4c82aba77387 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0570667 Nov 15 12:41:27.682106 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-042eaca7-0d08-4be8-a356-43732d83b294 req-ddef3810-4640-46c2-bc5f-768f49178a78 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788629 Nov 15 12:41:28.548978 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b3425e-ccc3-4960-86d8-9d741de3954a req-c8abe868-3017-4166-952a-044835ead61c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:28.551297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c5b3425e-ccc3-4960-86d8-9d741de3954a req-c8abe868-3017-4166-952a-044835ead61c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 944 time: 0.0801811 Nov 15 12:41:28.633075 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c5b3425e-ccc3-4960-86d8-9d741de3954a req-d5a76b64-7a96-4d5f-ba3e-6cc054af01df tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696764 Nov 15 12:41:28.835015 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688f889d-b957-46be-9e50-5a6e06441deb req-0d882278-35c0-4a00-97bf-3f1eaebefd8c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:28.836981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-688f889d-b957-46be-9e50-5a6e06441deb req-0d882278-35c0-4a00-97bf-3f1eaebefd8c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0543735 Nov 15 12:41:28.915721 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-688f889d-b957-46be-9e50-5a6e06441deb req-c0232370-c9dc-4c83-870a-ee494c978cd0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710802 Nov 15 12:41:29.761547 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36587ed-482f-4498-8d84-b33902250ef4 req-812eff94-9e33-4fe1-adc9-2847e4489d14 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:29.762981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f36587ed-482f-4498-8d84-b33902250ef4 req-812eff94-9e33-4fe1-adc9-2847e4489d14 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 944 time: 0.0515485 Nov 15 12:41:30.011929 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f36587ed-482f-4498-8d84-b33902250ef4 req-e921229d-9f28-4155-a159-bb55b56ae321 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2428851 Nov 15 12:41:30.124991 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f469682-b615-4398-9954-a7b206e7b8d0 req-0363b02a-9082-4e2c-83ab-6c8fb0985d77 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:30.126534 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f469682-b615-4398-9954-a7b206e7b8d0 req-0363b02a-9082-4e2c-83ab-6c8fb0985d77 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0491710 Nov 15 12:41:30.179459 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f469682-b615-4398-9954-a7b206e7b8d0 req-3647bf57-2a30-4e53-87ff-aaa362d59b75 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465250 Nov 15 12:41:30.759706 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:41:31.166867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55630ae4-05fd-4b36-bddc-831a54842f55 req-a31f493e-1a12-4fed-a95a-3d33d7cc9470 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:31.168521 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-55630ae4-05fd-4b36-bddc-831a54842f55 req-a31f493e-1a12-4fed-a95a-3d33d7cc9470 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 944 time: 0.0621779 Nov 15 12:41:31.170832 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device a106f2a9-c144-4b28-9287-b71a667e6786 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:41:31.241529 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-55630ae4-05fd-4b36-bddc-831a54842f55 req-1243af55-c56e-49da-9b4d-69110bf897c2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664485 Nov 15 12:41:31.260248 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port a106f2a9-c144-4b28-9287-b71a667e6786 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:41:31.269119 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port a106f2a9-c144-4b28-9287-b71a667e6786 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:41:31.269602 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:31.334074 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c0a6d8-b553-4cd7-bc09-6dc88f12990c req-cd19ad33-3664-4e02-b0b6-826b203da030 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:31.340186 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-94c0a6d8-b553-4cd7-bc09-6dc88f12990c req-cd19ad33-3664-4e02-b0b6-826b203da030 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0788922 Nov 15 12:41:31.407293 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-94c0a6d8-b553-4cd7-bc09-6dc88f12990c req-00f96721-23f9-4be3-b27a-4dfa598ec50c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576668 Nov 15 12:41:31.408612 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:31.444974 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:31.447644 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d910c5a3-de50-4687-bd8d-51c9763dc65a" -d '{"events": [{"server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "name": "network-vif-plugged", "status": "completed", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:31.464997 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=a106f2a9-c144-4b28-9287-b71a667e6786,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:31.469705 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:31.509642 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7e7603d-9fb1-4d3c-aeb0-7ac18ae29f53 x-openstack-request-id: req-a7e7603d-9fb1-4d3c-aeb0-7ac18ae29f53 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:31.510096 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "name": "network-vif-plugged", "status": "completed", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:31.510358 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-a7e7603d-9fb1-4d3c-aeb0-7ac18ae29f53 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:31.510755 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786', 'code': 200} Nov 15 12:41:31.546121 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:31.855277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa7098b-73e5-43a4-a37c-2c6cca87e84e req-4f02b91f-fb02-467d-9945-828ae58dc098 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:31.856903 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3fa7098b-73e5-43a4-a37c-2c6cca87e84e req-4f02b91f-fb02-467d-9945-828ae58dc098 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 1098 time: 0.0689819 Nov 15 12:41:31.943237 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3fa7098b-73e5-43a4-a37c-2c6cca87e84e req-6a109d00-609b-4707-be5b-87012eac53d5 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660772 Nov 15 12:41:32.446773 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f98bf713-1ca2-43fd-adcb-9c51540e0247 req-57420b91-86ee-433b-a80c-18a4893553ce tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:32.448520 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f98bf713-1ca2-43fd-adcb-9c51540e0247 req-57420b91-86ee-433b-a80c-18a4893553ce tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0905323 Nov 15 12:41:32.515926 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f98bf713-1ca2-43fd-adcb-9c51540e0247 req-830fda26-ff82-4701-95bc-650a3da13861 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585067 Nov 15 12:41:32.644561 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38fb82b-de30-4799-a281-a3882e862804 req-5eee32fe-5f05-43f1-8620-93851053d486 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:32.647121 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d38fb82b-de30-4799-a281-a3882e862804 req-5eee32fe-5f05-43f1-8620-93851053d486 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0873964 Nov 15 12:41:32.725795 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d38fb82b-de30-4799-a281-a3882e862804 req-9dfbb686-ed71-468d-8eb7-1f8059b701c9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670247 Nov 15 12:41:33.327978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5ab7d1bf-1427-4061-bd78-49e604a67082 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:33.652578 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0954c801-cf49-4e2a-bace-465b6bd294c2 req-1adceb3d-ee70-4783-b2e9-255c3a76248e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:33.654129 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0954c801-cf49-4e2a-bace-465b6bd294c2 req-1adceb3d-ee70-4783-b2e9-255c3a76248e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0552261 Nov 15 12:41:33.705665 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0954c801-cf49-4e2a-bace-465b6bd294c2 req-ce0a6096-66d1-494a-b9fc-537de1e90aa9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445962 Nov 15 12:41:33.853035 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88614fab-914a-4494-a186-27a87f464d54 req-19cb0d5e-3b62-459f-b592-077077f114a1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:33.854589 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-88614fab-914a-4494-a186-27a87f464d54 req-19cb0d5e-3b62-459f-b592-077077f114a1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0504711 Nov 15 12:41:33.903948 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-88614fab-914a-4494-a186-27a87f464d54 req-0e5818c1-732f-4be3-b0b1-ef9b467b2870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428557 Nov 15 12:41:34.830123 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4084c77a-0ff9-44c7-8e7e-d917ff75444f req-031dc0f4-3356-448b-ad66-fba80bbee4f6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:34.831679 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4084c77a-0ff9-44c7-8e7e-d917ff75444f req-031dc0f4-3356-448b-ad66-fba80bbee4f6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0498114 Nov 15 12:41:34.892650 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4084c77a-0ff9-44c7-8e7e-d917ff75444f req-12cf1528-f6d3-430d-b178-96d846cf63c7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549197 Nov 15 12:41:35.033747 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76aa2f2f-47a5-4857-ac3a-fbab20aa6eb2 req-214b6499-45d4-46ae-b2a0-8148e6ba1826 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:35.036104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-76aa2f2f-47a5-4857-ac3a-fbab20aa6eb2 req-214b6499-45d4-46ae-b2a0-8148e6ba1826 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0592246 Nov 15 12:41:35.086406 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-76aa2f2f-47a5-4857-ac3a-fbab20aa6eb2 req-a8251c99-171f-4cbb-bb41-d52be9777b3b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440652 Nov 15 12:41:35.740968 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7fd4a133-ce51-45f2-9ae7-bf2475acc1a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:36.009294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b132b594-f0fc-48ff-ad9c-6798354588aa req-bef13e40-3b6a-4be6-882a-296751031a96 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:36.010773 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b132b594-f0fc-48ff-ad9c-6798354588aa req-bef13e40-3b6a-4be6-882a-296751031a96 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0487611 Nov 15 12:41:36.071092 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b132b594-f0fc-48ff-ad9c-6798354588aa req-f61fbb0f-ef8f-4062-a529-1716444527b8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505464 Nov 15 12:41:36.226136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7c05e2-41e3-408e-91a0-41f289209c75 req-94c94643-6278-47c4-b7d4-8ab2d8665bd2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:36.228636 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e7c05e2-41e3-408e-91a0-41f289209c75 req-94c94643-6278-47c4-b7d4-8ab2d8665bd2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0644422 Nov 15 12:41:36.295983 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e7c05e2-41e3-408e-91a0-41f289209c75 req-a638933e-ea88-4dc1-b0d7-f49273ff4c8c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558143 Nov 15 12:41:36.855836 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:37.303438 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c24d20-1547-492e-9669-90b1f0c1072c req-2797aebd-6afa-4305-b35a-1baaebfc5134 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:37.306998 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28c24d20-1547-492e-9669-90b1f0c1072c req-2797aebd-6afa-4305-b35a-1baaebfc5134 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.1057723 Nov 15 12:41:37.406990 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28c24d20-1547-492e-9669-90b1f0c1072c req-a5277c0e-39dd-4bfc-b7f1-e049294aea99 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751324 Nov 15 12:41:37.528031 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d20862-66e1-427b-bbdb-26869b94c84d req-b2b735c7-e58a-44db-85f3-b1b0ed1cbd5c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:37.531390 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-58d20862-66e1-427b-bbdb-26869b94c84d req-b2b735c7-e58a-44db-85f3-b1b0ed1cbd5c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0743330 Nov 15 12:41:37.588983 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-58d20862-66e1-427b-bbdb-26869b94c84d req-9d40cf98-fc9d-4fec-8d24-ddd13fa2d707 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470166 Nov 15 12:41:37.928229 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f83861-bbae-4ce0-afe1-29bd3d9dd166 req-b7616a80-e0c1-493d-91f6-d1e599f139f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:37.930504 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78f83861-bbae-4ce0-afe1-29bd3d9dd166 req-b7616a80-e0c1-493d-91f6-d1e599f139f0 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1098 time: 0.0506065 Nov 15 12:41:37.994686 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78f83861-bbae-4ce0-afe1-29bd3d9dd166 req-62e12a15-ca4e-4d17-8fcf-ad4b1ef83a7e service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563977 Nov 15 12:41:38.308834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:38.365693 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50606) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:38.534230 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:38.644375 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c23f41-4f00-4276-932c-b75c14117495 req-f5703e4d-55dc-4e26-91c0-a72d2599e30e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:38.646618 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b7c23f41-4f00-4276-932c-b75c14117495 req-f5703e4d-55dc-4e26-91c0-a72d2599e30e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0984826 Nov 15 12:41:38.749224 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:38.759004 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b7c23f41-4f00-4276-932c-b75c14117495 req-f0359b9a-01fe-4437-98e2-fffd62d9aa2a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010292 Nov 15 12:41:38.760741 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:38.773489 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f01ae76-7a04-43a7-b75c-dc8e1067881c req-bbf28fa2-a72a-4a4e-b981-f8aaa71e60d8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:38.775359 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6f01ae76-7a04-43a7-b75c-dc8e1067881c req-bbf28fa2-a72a-4a4e-b981-f8aaa71e60d8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0864537 Nov 15 12:41:38.816541 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6c0508f-254e-47b8-be2d-9a16d59eb406,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:38.820749 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=f6ddd1aea3cd448ab89ad5ad86461ce6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4533391 Nov 15 12:41:38.827645 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50620) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:38.828671 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.829150 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.829564 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.829978 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.830356 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.830827 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.831197 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.831593 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.831985 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.832400 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.833438 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.833438 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-028b7ffa-5ace-43e7-8792-2ec9af826add admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:38.918608 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6f01ae76-7a04-43a7-b75c-dc8e1067881c req-2e9753bd-84b9-48d1-8fd9-783cc8ccf6ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1339602 Nov 15 12:41:38.958019 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:39.002504 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:39.075592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:39.080165 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:39.082196 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a6c0508f-254e-47b8-be2d-9a16d59eb406 HTTP/1.1" status: 204 len: 168 time: 0.2529912 Nov 15 12:41:39.095069 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6c0508f-254e-47b8-be2d-9a16d59eb406,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:39.106658 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.107008 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.107359 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.108170 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.108170 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.108472 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.109095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.109465 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.109821 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.110251 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.110624 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.114653 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a88fd70c-8c73-4f18-ba41-f0be0b837ffb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:39.150121 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.126294 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974538b1-d075-4c17-b6b7-bfe98d7337ad req-50aaff09-3c61-49e3-9dd6-6eb352236ff5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:40.129031 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-974538b1-d075-4c17-b6b7-bfe98d7337ad req-50aaff09-3c61-49e3-9dd6-6eb352236ff5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0907311 Nov 15 12:41:40.159297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50670) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:40.188033 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50674) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:40.238403 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-974538b1-d075-4c17-b6b7-bfe98d7337ad req-b0cecf57-d60c-49c5-b7a5-d141db58873b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1001570 Nov 15 12:41:40.333425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-2128061303-network', 'tenant_id': '171ad5c938bc4bcebdf3addd4a1692dc'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:40.393153 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Made reservation on behalf of 171ad5c938bc4bcebdf3addd4a1692dc for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:40.398382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.404309 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6fb9f814-f39f-4870-9690-ef8ab8f8c4c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.414535 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.435510 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fde21d7-507d-4ef2-8c4f-4bfadb5f0e3c req-59c55286-7ffd-472e-a1d4-a68eb623e74b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:40.445624 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6fde21d7-507d-4ef2-8c4f-4bfadb5f0e3c req-59c55286-7ffd-472e-a1d4-a68eb623e74b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1034594 Nov 15 12:41:40.528543 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6fde21d7-507d-4ef2-8c4f-4bfadb5f0e3c req-ac5f8b36-be82-4c5f-8b45-45b236bae362 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813379 Nov 15 12:41:40.568933 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.568933 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.610148 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6fb9f814-f39f-4870-9690-ef8ab8f8c4c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.614546 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] vlan segment allocate from pool success with {'vlan_id': 625, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:41:40.618764 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6fb9f814-f39f-4870-9690-ef8ab8f8c4c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.630444 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0b880aa-7531-4afc-b2bc-0811ae872683,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:40.654406 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.655139 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Added segment eec395e4-864f-4540-8982-74f84a015989 of type vlan for network b7abe99c-ff8e-4248-acb4-9c230b0d78fd Nov 15 12:41:40.664488 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb9f814-f39f-4870-9690-ef8ab8f8c4c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f57ac05e-ace5-4f68-98d4-2abc071f9cad,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:40.720081 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-6fb9f814-f39f-4870-9690-ef8ab8f8c4c4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=4d97abdb393a48df8cb114ae590ae5d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5277107 Nov 15 12:41:40.721302 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50690) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:40.754022 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.806167 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.808385 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:40.809916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.842700 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6814833 Nov 15 12:41:40.847328 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.860604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50696) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:40.878514 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Request body: {'subnet': {'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-2128061303-subnet', 'tenant_id': '171ad5c938bc4bcebdf3addd4a1692dc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:40.949686 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:40.960104 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c689e42-eb9b-4542-97de-367440754d00 admin admin] Pushing event updated for resources: {'Network': ['ID=b7abe99c-ff8e-4248-acb4-9c230b0d78fd,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:40.987595 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:41:41.024216 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Made reservation on behalf of 171ad5c938bc4bcebdf3addd4a1692dc for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:41.027966 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30113338'] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.108227 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.111779 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.117114 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f57ac05e-ace5-4f68-98d4-2abc071f9cad HTTP/1.1" status: 204 len: 168 time: 0.3878179 Nov 15 12:41:41.148848 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a878ab-768f-48c9-b258-f537d2345190 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f57ac05e-ace5-4f68-98d4-2abc071f9cad,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:41.427918 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29998907', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30113320'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.543761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3f98b94d-b67f-41a2-843a-6c7c0c51fb68,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:41.564178 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Checking segment: {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:41.564552 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Network hostable DHCP agents. Network: b7abe99c-ff8e-4248-acb4-9c230b0d78fd, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:41:41.604398 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:41:41.627282 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, b7abe99c-ff8e-4248-acb4-9c230b0d78fd) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:41.637148 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:41.638307 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.641047 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f26dbe7-4d86-439c-a155-b67411608c47 None None] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:41.691394 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b86a9089-930f-4c65-9279-3d080d9a5256 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8241088 Nov 15 12:41:41.724649 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50726) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:41.757010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bed3df43-fa15-44b3-a06c-de912d016805 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:41.982538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bed3df43-fa15-44b3-a06c-de912d016805 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.013470 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bed3df43-fa15-44b3-a06c-de912d016805 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.050007 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d729b28-3f03-4177-8a5a-8a4dcbb41f6b None None] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:42.109081 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50738) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:42.180417 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50742) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:42.184752 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bed3df43-fa15-44b3-a06c-de912d016805 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=3c747109de67492cb29b082c6dac1821&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4568427 Nov 15 12:41:42.189706 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.272466 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-d1e21a8b-5d52-452b-a425-cc77d97db837 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2935116 Nov 15 12:41:42.273634 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bed3df43-fa15-44b3-a06c-de912d016805 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4490fcd-3feb-4b90-afbd-abf1b35103a8,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:42.361792 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.424349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-60cee00e-3be2-41b2-a317-cc1ec40a6acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:42.426954 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-60cee00e-3be2-41b2-a317-cc1ec40a6acf service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.0892370 Nov 15 12:41:42.429865 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.470498 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-350d1485-fe7f-4a71-8f15-d4a1e4214b58 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.556273 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.560020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.565663 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/b4490fcd-3feb-4b90-afbd-abf1b35103a8 HTTP/1.1" status: 204 len: 168 time: 0.3796787 Nov 15 12:41:42.591182 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8369f4a-dbce-452c-9f2d-fb8707152569 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4490fcd-3feb-4b90-afbd-abf1b35103a8,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:42.676103 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-e90f6c35-4c40-458e-9802-bb05fe6eaa27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:42.677017 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-350d1485-fe7f-4a71-8f15-d4a1e4214b58 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.679447 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-e90f6c35-4c40-458e-9802-bb05fe6eaa27 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.1686463 Nov 15 12:41:42.684060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-350d1485-fe7f-4a71-8f15-d4a1e4214b58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.767519 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-b7d0bc75-478c-4c95-b8c8-3a8406ceb93c service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.0677030 Nov 15 12:41:42.768311 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-350d1485-fe7f-4a71-8f15-d4a1e4214b58 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=db37784a860b458e832ebcf8d8006228&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6576691 Nov 15 12:41:42.770201 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-350d1485-fe7f-4a71-8f15-d4a1e4214b58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8b856eb-905c-429c-a7a5-00b7f5fe0e4d,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:42.774235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50752) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:42.856676 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.882321 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-ac6c32a6-9168-44be-aac7-cc3f3a933ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:42.886077 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-ac6c32a6-9168-44be-aac7-cc3f3a933ef6 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.0994577 Nov 15 12:41:42.898255 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:42.978709 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-50b283e0-1a69-4ccd-a3ed-931f65913574 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0658925 Nov 15 12:41:43.000287 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:43.006503 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:43.008807 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/b8b856eb-905c-429c-a7a5-00b7f5fe0e4d HTTP/1.1" status: 204 len: 168 time: 0.2326097 Nov 15 12:41:43.038642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9839bd0a-7f41-4838-85a4-0d08e9694c96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8b856eb-905c-429c-a7a5-00b7f5fe0e4d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:43.317357 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-6e591207-475d-437b-a96f-39831e4cf339 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3277583 Nov 15 12:41:43.476817 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9c369a87-8f67-4dd1-9daa-9440148ba4c8 req-17e6d3d8-b185-4482-93e4-c1f217521296 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1463587 Nov 15 12:41:43.704225 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2aa508f-bc5d-4cb0-a498-f479f1450b6e req-87d4b72c-c8fe-487c-9791-e7eb8e6b9ac9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:43.710084 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2aa508f-bc5d-4cb0-a498-f479f1450b6e req-87d4b72c-c8fe-487c-9791-e7eb8e6b9ac9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0982337 Nov 15 12:41:43.816533 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-e38a86b0-e803-4800-8c7d-999c77e0454c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:43.818248 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-e38a86b0-e803-4800-8c7d-999c77e0454c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.1069434 Nov 15 12:41:43.828932 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2aa508f-bc5d-4cb0-a498-f479f1450b6e req-38d14b4e-f5cc-4c32-b518-264267375573 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945852 Nov 15 12:41:44.016257 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-1df3ed4d-d45a-4009-a0e7-7fbe2cdbe437 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:44.017943 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-1df3ed4d-d45a-4009-a0e7-7fbe2cdbe437 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.1375651 Nov 15 12:41:44.089770 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50794) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:44.090504 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-eaca7d7b-d76f-4a2a-9077-15fc9c8a1f7a service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.0617146 Nov 15 12:41:44.193584 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-a80e41ce-0054-46e3-889e-90b82555ae15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:44.196215 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-a80e41ce-0054-46e3-889e-90b82555ae15 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.0818343 Nov 15 12:41:44.254848 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-895eb331-3ee2-455e-9c57-2c600c767fc6 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0445685 Nov 15 12:41:44.295617 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-461835304-network', 'tenant_id': 'ec8daa4ef8d04b26bbcb25140673b521'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:44.356486 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Made reservation on behalf of ec8daa4ef8d04b26bbcb25140673b521 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:44.364262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.391768 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.546893 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-ac543fd4-7075-43ff-887e-4bed1bfe28e2 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2732453 Nov 15 12:41:44.574517 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50816) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:44.605214 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.621316 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.684258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] vlan segment allocate from pool success with {'vlan_id': 627, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:41:44.702067 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c596bec-0793-4acc-b674-2a12504b285d,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:44.723300 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.725031 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Added segment 6cda2c25-0d50-4d83-ad90-443c53bdace9 of type vlan for network 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 Nov 15 12:41:44.812713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1167276369-network', 'tenant_id': '5d7b948b852c4d75927625acca00a4d6'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:44.836072 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.845933 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2f1e9ef-8e16-41e7-b637-89b1b60dc4db req-285c235e-3dd3-4305-a34b-b2000e0a95da service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2876763 Nov 15 12:41:44.861038 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Made reservation on behalf of 5d7b948b852c4d75927625acca00a4d6 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:44.866307 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.898300 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.899899 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:44.906766 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:44.990326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.102434 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.0109603 Nov 15 12:41:45.106400 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50842) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:45.111454 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Request body: {'subnet': {'network_id': '9e670dab-8b1b-4c0b-b957-09ab0f90a7e5', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-461835304-subnet', 'tenant_id': 'ec8daa4ef8d04b26bbcb25140673b521', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:45.131069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-72c83401-38a9-4fb2-970e-a596449c05cd tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:45.132661 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-72c83401-38a9-4fb2-970e-a596449c05cd tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 814 time: 0.2421722 Nov 15 12:41:45.153944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94947ee0-3c08-4db6-86ba-5849399227e4 admin admin] Pushing event updated for resources: {'Network': ['ID=9e670dab-8b1b-4c0b-b957-09ab0f90a7e5,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:45.175723 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:41:45.180704 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1daa4ef-5412-4df3-9003-77fe8e6d383f req-5271f051-4630-4b86-a528-f59d21319bea tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:45.189336 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1daa4ef-5412-4df3-9003-77fe8e6d383f req-5271f051-4630-4b86-a528-f59d21319bea tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1297534 Nov 15 12:41:45.198397 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-c09cc715-5ae6-4d47-9054-ca52a6f7d31d tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/quotas/171ad5c938bc4bcebdf3addd4a1692dc HTTP/1.1" status: 200 len: 375 time: 0.0490775 Nov 15 12:41:45.227320 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Made reservation on behalf of ec8daa4ef8d04b26bbcb25140673b521 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:45.229687 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30113338'] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.259963 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1daa4ef-5412-4df3-9003-77fe8e6d383f req-053f5dbd-3bed-427a-91fd-7247b4ec0ae4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694792 Nov 15 12:41:45.329484 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.334863 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-4d8edeea-5f44-49cf-b2b4-4ea409738303 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1109159 Nov 15 12:41:45.337810 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.440163 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] vlan segment allocate from pool success with {'vlan_id': 646, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:41:45.462893 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ab99b9e-d376-49f2-adcc-6257add5d4d7,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:45.478406 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.478754 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Added segment 75c34c2d-db36-477f-b460-e981d9675cdd of type vlan for network 29de8c58-f293-40d7-a944-86383e773ce7 Nov 15 12:41:45.590499 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.601116 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-d435fc40-bf4a-47f9-9b7a-54e9a8acd8b2 service neutron] 10.222.0.44 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2500131 Nov 15 12:41:45.702518 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:45.703347 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:45.703927 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.002805 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.4265559 Nov 15 12:41:46.008312 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50846) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:46.011286 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29998907', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30113320'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.016014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Request body: {'subnet': {'network_id': '29de8c58-f293-40d7-a944-86383e773ce7', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1167276369-subnet', 'tenant_id': '5d7b948b852c4d75927625acca00a4d6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:46.047903 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Made reservation on behalf of 5d7b948b852c4d75927625acca00a4d6 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:46.051855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.067660 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c809d907-41e7-445b-a6d7-bd0f2dce2de5 admin admin] Pushing event updated for resources: {'Network': ['ID=29de8c58-f293-40d7-a944-86383e773ce7,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:46.089539 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-3be343bf-010a-41d2-94fd-0d5933f1d5ca service neutron] 10.222.0.44 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4736147 Nov 15 12:41:46.090593 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 29de8c58-f293-40d7-a944-86383e773ce7 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:41:46.099247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Pushing event updated for resources: {'Subnet': ['ID=87c01f6f-c738-41c5-a2bb-dc0a81bcf412,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:46.122886 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Checking segment: {'id': '6cda2c25-0d50-4d83-ad90-443c53bdace9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9e670dab-8b1b-4c0b-b957-09ab0f90a7e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:46.123247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Network hostable DHCP agents. Network: 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:41:46.147084 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Network 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:41:46.165591 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:46.172993 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:46.174573 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.187543 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ececd4c-b621-4b5c-9b40-df59a70300db None None] Network 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:46.201725 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-6cc9aa23-e49e-40aa-af34-e21b7f0b413e admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0942240 Nov 15 12:41:46.451152 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.498235 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b4b5909d-75bf-498b-b2b1-26f486900844 req-93c8ebb6-4870-4c14-9ee5-3649a980d544 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 210 time: 0.0747929 Nov 15 12:41:46.513651 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c26569c0-bc29-43b9-ab98-88f225f9487d None None] Network 9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:46.584566 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c262ff8-39d2-4560-8a17-db7d1bd0eb4f,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:46.630632 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9415e4b5-7b65-4a50-a373-1d7e5566fa02 req-b41f6cc2-67ae-433e-953e-f622636d5dbd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:46.633433 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9415e4b5-7b65-4a50-a373-1d7e5566fa02 req-b41f6cc2-67ae-433e-953e-f622636d5dbd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1839657 Nov 15 12:41:46.687009 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Checking segment: {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:46.687653 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Network hostable DHCP agents. Network: 29de8c58-f293-40d7-a944-86383e773ce7, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:41:46.751988 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Network 29de8c58-f293-40d7-a944-86383e773ce7 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:41:46.775506 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9415e4b5-7b65-4a50-a373-1d7e5566fa02 req-f1467985-d306-471a-a443-6d277395b2f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1280203 Nov 15 12:41:46.778638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 29de8c58-f293-40d7-a944-86383e773ce7) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:46.792278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:46.792278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:46.799628 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9519683d-06b8-4089-9fc7-71069cfc77d9 None None] Network 29de8c58-f293-40d7-a944-86383e773ce7 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:46.819743 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-5ade34dc-4343-4bfa-ab0c-c20eb52e0443 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8098555 Nov 15 12:41:46.999187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0997a62c-b7c7-4ad6-8f76-523b2b18d92b None None] Network 29de8c58-f293-40d7-a944-86383e773ce7 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:47.269407 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 50888) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:47.278584 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-510800770-network', 'tenant_id': 'e3bbe3e028624894a8f67c802e671e9b'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:47.310413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Made reservation on behalf of e3bbe3e028624894a8f67c802e671e9b for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:47.314321 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.324949 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.427959 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.432733 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.461128 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] vlan segment allocate from pool success with {'vlan_id': 644, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:41:47.471630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83c00358-94c2-4004-b1ea-987aa29c7694,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:47.476948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.477294 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Added segment 77de31ed-16f6-4603-8329-20095cae48ee of type vlan for network 1b84812e-b9f8-41f8-a398-c1800e24b8c5 Nov 15 12:41:47.531973 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.566181 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.567187 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:47.568003 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.642451 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3700974 Nov 15 12:41:47.647077 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 50894) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:41:47.652420 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Request body: {'subnet': {'network_id': '1b84812e-b9f8-41f8-a398-c1800e24b8c5', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-510800770-subnet', 'tenant_id': 'e3bbe3e028624894a8f67c802e671e9b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:47.693780 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Made reservation on behalf of e3bbe3e028624894a8f67c802e671e9b for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:47.697037 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30113338'] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.697758 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8a56ecc5-073f-4552-9ab4-d980862d2f7f req-bf3c19f9-2de6-416a-b558-45826dfe1193 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 210 time: 0.0539238 Nov 15 12:41:47.698729 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b502436-9b93-44e6-98b6-7b18e3eaf5b9 admin admin] Pushing event updated for resources: {'Network': ['ID=1b84812e-b9f8-41f8-a398-c1800e24b8c5,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:47.715556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 1b84812e-b9f8-41f8-a398-c1800e24b8c5 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:41:47.967818 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29998907', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30113320'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:47.976095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091a912e-c35f-4b69-9046-0f3dd9c75385 req-3bd7ec4b-20ef-4265-8378-735ab518aa43 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:47.977688 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-091a912e-c35f-4b69-9046-0f3dd9c75385 req-3bd7ec4b-20ef-4265-8378-735ab518aa43 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0759463 Nov 15 12:41:48.043671 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-091a912e-c35f-4b69-9046-0f3dd9c75385 req-e6fc98bc-a035-469a-a21a-8885c0635bba tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574534 Nov 15 12:41:48.074849 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e133d329-6421-43a8-9f84-6ef51bb648e6,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:48.088660 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Checking segment: {'id': '77de31ed-16f6-4603-8329-20095cae48ee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '1b84812e-b9f8-41f8-a398-c1800e24b8c5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:48.089235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Network hostable DHCP agents. Network: 1b84812e-b9f8-41f8-a398-c1800e24b8c5, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:41:48.116291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Network 1b84812e-b9f8-41f8-a398-c1800e24b8c5 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:41:48.126798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 1b84812e-b9f8-41f8-a398-c1800e24b8c5) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:48.131539 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:48.132460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:48.138439 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70518ef7-d243-42fc-8702-fe9aa4df208d None None] Network 1b84812e-b9f8-41f8-a398-c1800e24b8c5 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:48.157000 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4c685e78-411a-4b4d-955f-f2533038a325 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5082879 Nov 15 12:41:48.329304 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd1f00e7-dced-457d-addb-a859d9a782dd None None] Network 1b84812e-b9f8-41f8-a398-c1800e24b8c5 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:41:48.827593 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7feaf2ff-b03a-4931-b459-f73de7df927b req-5d36151f-a95c-45b0-b654-cc29097e72c7 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 210 time: 0.0288501 Nov 15 12:41:49.219710 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d654851c-9361-4e8a-97a1-a09287dade0a req-682674ed-cbdf-4c4f-aef7-0f3bbf85010e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:49.223524 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d654851c-9361-4e8a-97a1-a09287dade0a req-682674ed-cbdf-4c4f-aef7-0f3bbf85010e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0885792 Nov 15 12:41:49.282598 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d654851c-9361-4e8a-97a1-a09287dade0a req-14c6e5a6-029b-4deb-b725-8ec99bf0c058 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491858 Nov 15 12:41:50.060930 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d2b6637-524b-4673-ad07-24e36f0538e2 req-20a4f137-303d-4dc0-a05e-fffbf6691f75 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 210 time: 0.1182246 Nov 15 12:41:50.135444 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-404e1828-243f-4c64-b520-0b13d4830e2b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:50.137307 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-404e1828-243f-4c64-b520-0b13d4830e2b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 814 time: 0.2342129 Nov 15 12:41:50.204577 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Request body: {'port': {'device_id': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd', 'admin_state_up': True, 'tenant_id': '171ad5c938bc4bcebdf3addd4a1692dc'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:50.430008 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Made reservation on behalf of 171ad5c938bc4bcebdf3addd4a1692dc for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:50.435538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:50.484638 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523b75cc-f3ea-44d9-8883-d44528edbe1b req-71f6cd87-7598-4b1d-b393-c0dfd8eb4801 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:50.487207 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-523b75cc-f3ea-44d9-8883-d44528edbe1b req-71f6cd87-7598-4b1d-b393-c0dfd8eb4801 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1011958 Nov 15 12:41:50.669138 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-523b75cc-f3ea-44d9-8883-d44528edbe1b req-62dbd731-41e3-4fa3-8503-6f6a4f3f36d6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505759 Nov 15 12:41:50.703262 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Allocated IP 172.20.0.3 (b7abe99c-ff8e-4248-acb4-9c230b0d78fd/3f98b94d-b67f-41a2-843a-6c7c0c51fb68/9ee6042d-0234-4720-8aa3-b1782096594e) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:41:50.909655 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:50.952375 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:51.028079 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:41:51.031571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:51.035123 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:41:51.072748 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Pushing event updated for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:51.131555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:51.132743 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:51.158765 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-39815e78-b30a-497f-8b2b-85df06ed5d18 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9633417 Nov 15 12:41:51.205346 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Request body: {'port': {'device_id': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:51.325969 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc081e02-dd5f-4aa6-ba1d-62ecad150747 req-8feb8e13-00f4-46ee-8625-0da660e52371 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:51.327874 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc081e02-dd5f-4aa6-ba1d-62ecad150747 req-8feb8e13-00f4-46ee-8625-0da660e52371 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 931 time: 0.0982010 Nov 15 12:41:51.329264 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:51.434614 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc081e02-dd5f-4aa6-ba1d-62ecad150747 req-1728a21a-2aff-416f-b575-fa9e7711d622 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941844 Nov 15 12:41:51.720729 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ee6042d-0234-4720-8aa3-b1782096594e {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:41:51.733290 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:51.756785 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Transition to ACTIVE for port object 9ee6042d-0234-4720-8aa3-b1782096594e will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:41:51.765341 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:51.844236 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Pushing event updated for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:51.879902 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91163ac1-79fc-4a8a-af0f-3fb01f3a3f7f req-c89b9354-6c1f-4710-9352-927543c5a05a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:51.883382 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-91163ac1-79fc-4a8a-af0f-3fb01f3a3f7f req-c89b9354-6c1f-4710-9352-927543c5a05a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1062872 Nov 15 12:41:51.960501 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-91163ac1-79fc-4a8a-af0f-3fb01f3a3f7f req-f9e98c42-e4b7-47fc-bcb7-b96cf83ddd9d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658975 Nov 15 12:41:51.961766 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Attempting to bind port 9ee6042d-0234-4720-8aa3-b1782096594e on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:41:51.962275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Attempting to bind port 9ee6042d-0234-4720-8aa3-b1782096594e by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:41:51.962596 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Attempting to bind port 9ee6042d-0234-4720-8aa3-b1782096594e on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:51.968399 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Port 9ee6042d-0234-4720-8aa3-b1782096594e on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:41:51.968847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Attempting to bind port 9ee6042d-0234-4720-8aa3-b1782096594e on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:51.976725 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 41, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:41:51.977266 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Checking segment: {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:51.977891 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Bound using segment: {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:41:51.978593 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Bound port: 9ee6042d-0234-4720-8aa3-b1782096594e, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:41:51.979157 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:52.056623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:41:52.060860 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9ee6042d-0234-4720-8aa3-b1782096594e,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:41:52.066637 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:52.104595 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:52.105432 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:52.106679 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] 10.222.0.61 "PUT /v2.0/ports/9ee6042d-0234-4720-8aa3-b1782096594e HTTP/1.1" status: 200 len: 1093 time: 0.9164569 Nov 15 12:41:52.107133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:41:52.109488 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a3c7d03-6953-47c4-a707-158018febd1b" -d '{"events": [{"name": "network-changed", "server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:41:52.146022 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575b631c-32e8-4753-9b63-29c5c340fe18 service neutron] Pushing event updated for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:52.183983 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:41:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63fca30c-aef3-4079-bdff-709008213864 x-openstack-request-id: req-63fca30c-aef3-4079-bdff-709008213864 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:41:52.184492 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:41:52.184904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-63fca30c-aef3-4079-bdff-709008213864 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:41:52.185868 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e', 'status': 'completed', 'code': 200} Nov 15 12:41:52.313044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-03e50fd5-d82c-49e7-a4fe-97a8f564ca94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:52.316916 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-03e50fd5-d82c-49e7-a4fe-97a8f564ca94 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 1096 time: 0.0703423 Nov 15 12:41:52.417234 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-4ab54d65-bb6a-43f2-844b-e414e48b2b1d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9ee6042d-0234-4720-8aa3-b1782096594e HTTP/1.1" status: 200 len: 217 time: 0.0612376 Nov 15 12:41:52.489315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-8c47a189-8c3f-469a-8355-64e592c56b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:52.494341 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-8c47a189-8c3f-469a-8355-64e592c56b4a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=3f98b94d-b67f-41a2-843a-6c7c0c51fb68 HTTP/1.1" status: 200 len: 854 time: 0.0564091 Nov 15 12:41:52.547259 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-2d352e2e-8548-460a-977d-c3f09be3a97a service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0325437 Nov 15 12:41:52.738989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-8469255a-68f3-4d2c-9676-9bd18f9be8f4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:52.741976 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-8469255a-68f3-4d2c-9676-9bd18f9be8f4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/networks?id=29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 200 len: 809 time: 0.2124121 Nov 15 12:41:52.776972 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-31afd881-8bba-4c34-ad69-ef679ebbb12f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/quotas/5d7b948b852c4d75927625acca00a4d6 HTTP/1.1" status: 200 len: 375 time: 0.0252287 Nov 15 12:41:52.807515 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-438a744f-5edf-45e4-bf87-d39c88d1657b service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2055209 Nov 15 12:41:52.830936 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-65768353-4cbb-4e06-b1b4-b4daa5047225 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0501173 Nov 15 12:41:52.972879 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-67dc5a84-2b48-46c4-a3db-79512700ec44 service neutron] 10.222.0.44 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1408279 Nov 15 12:41:53.007604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61a58be-7f9c-454e-a17a-bdbb8385d41f req-db9f2d4c-df18-4083-86e6-30007244f0e9 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:53.009302 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e61a58be-7f9c-454e-a17a-bdbb8385d41f req-db9f2d4c-df18-4083-86e6-30007244f0e9 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 943 time: 0.1913583 Nov 15 12:41:53.148552 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-18f3ef83-8302-4603-8c59-68e1e9c8324a service neutron] 10.222.0.44 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1681130 Nov 15 12:41:53.150147 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e61a58be-7f9c-454e-a17a-bdbb8385d41f req-a13fca0f-c70f-48c3-94ce-8a4c3c00c18f tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1295950 Nov 15 12:41:53.208150 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4f840212-30ea-43c5-8e88-475ae6da7b1e req-2f2122c2-1f8b-4311-8991-b10d408b2caf service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3353801 Nov 15 12:41:53.438400 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afaa4f9-f207-4dfd-9cac-234ce98fd927 req-c106d316-fb99-41c1-93e7-0d9fd7f41617 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:53.438777 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b9b9da0c-223f-4f61-b4a5-2d57bd8aaab4 req-57b931e8-8e40-4f81-9522-3489bc13875a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 210 time: 0.0592821 Nov 15 12:41:53.440764 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1afaa4f9-f207-4dfd-9cac-234ce98fd927 req-c106d316-fb99-41c1-93e7-0d9fd7f41617 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1136804 Nov 15 12:41:53.473189 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c7d03-6953-47c4-a707-158018febd1b req-eacf107c-38f4-4889-b2ca-6e5560b0add7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:53.474757 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-eacf107c-38f4-4889-b2ca-6e5560b0add7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 1096 time: 0.0877805 Nov 15 12:41:53.553029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1afaa4f9-f207-4dfd-9cac-234ce98fd927 req-b7aab474-8086-4811-bcae-c08fc124b949 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026304 Nov 15 12:41:53.602073 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c7d03-6953-47c4-a707-158018febd1b req-6eb94b38-e8b3-45f3-a449-960475f37406 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:53.603531 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-6eb94b38-e8b3-45f3-a449-960475f37406 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 915 time: 0.1143801 Nov 15 12:41:53.669763 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-a4f0807b-f33c-491e-91ce-69cf19e58e41 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=9ee6042d-0234-4720-8aa3-b1782096594e HTTP/1.1" status: 200 len: 217 time: 0.0466576 Nov 15 12:41:53.757194 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c7d03-6953-47c4-a707-158018febd1b req-350fb64d-aea7-4237-84d9-97652026fea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:53.759877 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-350fb64d-aea7-4237-84d9-97652026fea8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=3f98b94d-b67f-41a2-843a-6c7c0c51fb68 HTTP/1.1" status: 200 len: 854 time: 0.0772004 Nov 15 12:41:53.834809 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-c5011f9a-cad6-4f8a-9ba4-ca1abdd2c282 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0433559 Nov 15 12:41:53.999438 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-ea24f99a-8708-4644-a454-10a3c7c8dec3 service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1508765 Nov 15 12:41:54.193690 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a3c7d03-6953-47c4-a707-158018febd1b req-9624ecfd-5e8a-4178-b003-3c2f2d5d2e18 service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1800365 Nov 15 12:41:54.417887 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d69c285f-62a1-40bd-8dac-61da3967b575 req-1f5b5ca7-338e-4ad8-94d0-a02dbec6b121 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:54.419885 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d69c285f-62a1-40bd-8dac-61da3967b575 req-1f5b5ca7-338e-4ad8-94d0-a02dbec6b121 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 943 time: 0.1550295 Nov 15 12:41:54.535066 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d69c285f-62a1-40bd-8dac-61da3967b575 req-7903330e-cbdc-4bbc-bc0e-a152563bf689 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934212 Nov 15 12:41:54.629716 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8ddb5d04-dfa0-4500-8d6b-3b9735973c29 req-55f4a491-26fd-4230-9485-69f9d4eb7583 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 210 time: 0.0505857 Nov 15 12:41:54.757374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7901669d-c2a1-4c09-8bc4-61e13675b8ff req-918170bc-772d-455a-a639-33b2149f1c59 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:54.760491 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7901669d-c2a1-4c09-8bc4-61e13675b8ff req-918170bc-772d-455a-a639-33b2149f1c59 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0805712 Nov 15 12:41:54.854503 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7901669d-c2a1-4c09-8bc4-61e13675b8ff req-b576f24b-6a17-46ac-8980-9506c98ad9f0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800443 Nov 15 12:41:55.048460 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-f80fbd22-cb22-4c39-b75e-6bf0da27f9ff tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:55.051165 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-f80fbd22-cb22-4c39-b75e-6bf0da27f9ff tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.1779108 Nov 15 12:41:55.071401 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-11c687fd-ac9d-4b83-8da4-b9155b1967ff tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/quotas/27402858adce449996a04024b968bae3 HTTP/1.1" status: 200 len: 375 time: 0.0106871 Nov 15 12:41:55.146781 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-0bef92da-8de2-42df-9783-021aea40b733 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0674150 Nov 15 12:41:55.279016 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-b8b11cf7-9194-4830-9032-783b02463842 service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1195903 Nov 15 12:41:55.450612 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-bc74a193-86b3-4ad2-ad94-f425f5e8b85f service neutron] 10.222.0.44 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1647973 Nov 15 12:41:55.504888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-0a6930d9-1966-414b-a712-57c87751ddf4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:55.507901 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-0a6930d9-1966-414b-a712-57c87751ddf4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "GET /v2.0/networks?id=29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 200 len: 809 time: 0.1828501 Nov 15 12:41:55.561283 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Request body: {'port': {'device_id': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7', 'admin_state_up': True, 'tenant_id': '5d7b948b852c4d75927625acca00a4d6'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:55.749471 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16795a9f-d9bf-4822-9096-0833756af4a3 req-8a4133b0-f96c-4a3e-bd1d-de9f199155d0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0412376 Nov 15 12:41:55.816938 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52d32e1-f64d-4774-8e80-80af49fbc822 req-6d8faf22-3822-43fa-8645-dce80b7e2e8c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:55.829864 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e52d32e1-f64d-4774-8e80-80af49fbc822 req-6d8faf22-3822-43fa-8645-dce80b7e2e8c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 943 time: 0.1450436 Nov 15 12:41:55.895875 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-71d0eda3-c80b-40bb-88da-efedddd29ea1 req-b091a796-5632-470e-b2f2-a0a12b084795 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 210 time: 0.0583324 Nov 15 12:41:55.932112 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Made reservation on behalf of 5d7b948b852c4d75927625acca00a4d6 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:41:55.936490 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:55.998690 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e52d32e1-f64d-4774-8e80-80af49fbc822 req-93b2ae6e-fceb-44b0-8012-0db30d3bfda1 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1593654 Nov 15 12:41:56.119225 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edadb4dd-c345-48ab-b5b3-1cce91a07f09 req-db80c4ae-c600-474f-ac01-8f19a0daf82a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:56.121146 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-edadb4dd-c345-48ab-b5b3-1cce91a07f09 req-db80c4ae-c600-474f-ac01-8f19a0daf82a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0837569 Nov 15 12:41:56.214906 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-edadb4dd-c345-48ab-b5b3-1cce91a07f09 req-535b1227-a2f9-45d9-8e66-2edaa1671efc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743010 Nov 15 12:41:56.258987 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Allocated IP 172.20.0.11 (29de8c58-f293-40d7-a944-86383e773ce7/9c262ff8-39d2-4560-8a17-db7d1bd0eb4f/09343116-80f7-47b2-97ab-e055673c6092) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:41:56.480623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:56.517204 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:56.561335 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Network 29de8c58-f293-40d7-a944-86383e773ce7 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:41:56.564566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:41:56.569104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:41:56.575404 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Pushing event updated for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:56.622027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:56.622632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:56.639340 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-6a12b377-4431-4440-8507-0b38c1aff620 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0862961 Nov 15 12:41:56.865182 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6ede07c1-6cff-437b-a610-e0a4f3ad40c8 req-f486533d-8c0b-4876-bbf5-10b792ba2a71 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0284033 Nov 15 12:41:57.037317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0cbdc78-1d20-4438-bc05-0e6e57f3171c req-adebb0a4-3df6-4c37-a9b7-c2efbb0afcf3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:57.039064 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d0cbdc78-1d20-4438-bc05-0e6e57f3171c req-adebb0a4-3df6-4c37-a9b7-c2efbb0afcf3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 932 time: 0.0611196 Nov 15 12:41:57.117463 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d0cbdc78-1d20-4438-bc05-0e6e57f3171c req-9854a1c7-5652-49aa-bc6c-2a5b0020a16e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665534 Nov 15 12:41:57.245307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c924f6-b480-4eae-aa6a-8d1b2a531c79 req-84caa223-9700-447f-a867-fef9c3f76647 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:57.247895 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40c924f6-b480-4eae-aa6a-8d1b2a531c79 req-84caa223-9700-447f-a867-fef9c3f76647 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 943 time: 0.0626423 Nov 15 12:41:57.313863 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40c924f6-b480-4eae-aa6a-8d1b2a531c79 req-caec93a1-387f-4f2d-ac54-9453ea91777b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576985 Nov 15 12:41:57.432024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e587cda5-b34b-4980-bd8e-607b51830a1a req-70daf28c-c838-449b-9705-4e1edcfa81f5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:57.433646 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e587cda5-b34b-4980-bd8e-607b51830a1a req-70daf28c-c838-449b-9705-4e1edcfa81f5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0556238 Nov 15 12:41:57.487695 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e587cda5-b34b-4980-bd8e-607b51830a1a req-d24a6a6c-4662-49c4-8497-0e2fa4978484 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469534 Nov 15 12:41:57.985382 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bbf66704-4b31-42e1-860e-399cd2155269 req-28a24b65-1844-4103-8844-7a3a7e70e617 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0413845 Nov 15 12:41:58.248847 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ab281d-01dd-434c-8bec-39092ccfbe19 req-61a460bb-9c46-440c-9526-c674e2f782e3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:58.250364 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a0ab281d-01dd-434c-8bec-39092ccfbe19 req-61a460bb-9c46-440c-9526-c674e2f782e3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 932 time: 0.0518687 Nov 15 12:41:58.303389 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a0ab281d-01dd-434c-8bec-39092ccfbe19 req-1c71d4a5-9b31-4102-91d0-3a27fde823a9 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462351 Nov 15 12:41:58.447382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2884fb12-f881-4140-b3f8-42411df25315 req-7e7e4671-1bef-444d-a145-77003f45d4ff tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:58.448848 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2884fb12-f881-4140-b3f8-42411df25315 req-7e7e4671-1bef-444d-a145-77003f45d4ff tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 943 time: 0.0613289 Nov 15 12:41:58.502158 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2884fb12-f881-4140-b3f8-42411df25315 req-6f171044-dff7-4549-aae9-3c2bc0f332f1 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470600 Nov 15 12:41:58.617832 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5426b6f8-6704-44a7-bbc6-540e01c4b8df req-c395d169-73a7-4670-a6ee-b339f904c4ea tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:58.619336 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5426b6f8-6704-44a7-bbc6-540e01c4b8df req-c395d169-73a7-4670-a6ee-b339f904c4ea tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0573876 Nov 15 12:41:58.678304 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5426b6f8-6704-44a7-bbc6-540e01c4b8df req-7f9e1c69-4e13-42ce-9d52-89b4274080f0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484746 Nov 15 12:41:59.011608 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9ee6042d-0234-4720-8aa3-b1782096594e details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:41:59.061445 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Request body: {'port': {'device_id': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:41:59.109693 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e5e32e70-b05e-4981-a79c-e463a17cf68d req-9f27ddc0-d273-41a0-9d77-0b7ae22dcd90 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0376801 Nov 15 12:41:59.161981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:59.162596 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9ee6042d-0234-4720-8aa3-b1782096594e,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:59.179440 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '9ee6042d-0234-4720-8aa3-b1782096594e', 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd', 'port_id': '9ee6042d-0234-4720-8aa3-b1782096594e', 'mac_address': 'fa:16:3e:17:87:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3f98b94d-b67f-41a2-843a-6c7c0c51fb68', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:41:59.252705 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:59.274587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ee6042d-0234-4720-8aa3-b1782096594e {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:41:59.311614 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9ee6042d-0234-4720-8aa3-b1782096594e,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:41:59.318483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:59.390778 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:59.400892 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.401530 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.402062 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.402397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.402719 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.403335 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.403814 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.404326 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.404829 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.405297 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.405893 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.406359 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:41:59.510417 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a43a5d5-f24b-475d-a5fd-ac852b68dfd0 req-80ecf2cf-0a20-4679-afb1-13f1049cb3b3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:59.513929 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1a43a5d5-f24b-475d-a5fd-ac852b68dfd0 req-80ecf2cf-0a20-4679-afb1-13f1049cb3b3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 932 time: 0.0873370 Nov 15 12:41:59.596591 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1a43a5d5-f24b-475d-a5fd-ac852b68dfd0 req-339940d8-37a9-4279-a0c2-2342f00d2257 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702758 Nov 15 12:41:59.648813 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 09343116-80f7-47b2-97ab-e055673c6092 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:41:59.676348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:59.695459 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Transition to ACTIVE for port object 09343116-80f7-47b2-97ab-e055673c6092 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:41:59.707102 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:41:59.729753 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240937e5-3664-44b0-b178-5a6b0915dc07 req-139df5fc-41de-40b1-be3f-21d69bc39af5 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:59.732225 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-240937e5-3664-44b0-b178-5a6b0915dc07 req-139df5fc-41de-40b1-be3f-21d69bc39af5 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 944 time: 0.1059470 Nov 15 12:41:59.828901 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Pushing event updated for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:41:59.854475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96477772-902a-4ac9-b5c9-65da5f69bb30 req-25f3b6c9-2c42-40eb-9a63-af00a3bc46e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:41:59.857239 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-96477772-902a-4ac9-b5c9-65da5f69bb30 req-25f3b6c9-2c42-40eb-9a63-af00a3bc46e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0960016 Nov 15 12:41:59.891867 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-240937e5-3664-44b0-b178-5a6b0915dc07 req-1099568b-9b27-4411-9bc8-6327d97b2fc4 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1277623 Nov 15 12:41:59.941767 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Attempting to bind port 09343116-80f7-47b2-97ab-e055673c6092 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:41:59.942326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Attempting to bind port 09343116-80f7-47b2-97ab-e055673c6092 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:41:59.942876 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Attempting to bind port 09343116-80f7-47b2-97ab-e055673c6092 on network 29de8c58-f293-40d7-a944-86383e773ce7 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:59.947805 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-96477772-902a-4ac9-b5c9-65da5f69bb30 req-ffd90b1f-6357-4e6c-99a4-53fdb25753e2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796657 Nov 15 12:41:59.952475 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Port 09343116-80f7-47b2-97ab-e055673c6092 on network 29de8c58-f293-40d7-a944-86383e773ce7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:41:59.953012 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Attempting to bind port 09343116-80f7-47b2-97ab-e055673c6092 on network 29de8c58-f293-40d7-a944-86383e773ce7 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:41:59.958767 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['9ee6042d-0234-4720-8aa3-b1782096594e'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:41:59.964100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 41, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:41:59.964738 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Checking segment: {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:41:59.965362 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Bound using segment: {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:41:59.966189 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Bound port: 09343116-80f7-47b2-97ab-e055673c6092, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:41:59.966798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:00.070513 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:00.076631 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=09343116-80f7-47b2-97ab-e055673c6092,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:00.083417 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:00.127696 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:00.128754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:00.129859 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] 10.222.0.61 "PUT /v2.0/ports/09343116-80f7-47b2-97ab-e055673c6092 HTTP/1.1" status: 200 len: 1094 time: 1.0765328 Nov 15 12:42:00.130329 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'tag': '09343116-80f7-47b2-97ab-e055673c6092'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:00.132801 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07588f09-a5aa-41bf-a02e-10130c37d97d" -d '{"events": [{"name": "network-changed", "server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "tag": "09343116-80f7-47b2-97ab-e055673c6092"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:00.181390 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26d6bb7b-7123-4f46-b543-f5ac79620d1e service neutron] Pushing event updated for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:00.218069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-118156d1-9159-49a7-892e-80aa04c6401d x-openstack-request-id: req-118156d1-9159-49a7-892e-80aa04c6401d {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:00.218752 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "tag": "09343116-80f7-47b2-97ab-e055673c6092", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:00.219342 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-118156d1-9159-49a7-892e-80aa04c6401d {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:00.219902 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'tag': '09343116-80f7-47b2-97ab-e055673c6092', 'status': 'completed', 'code': 200} Nov 15 12:42:00.337270 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5ad5f293-b2b2-4b1f-b577-0c282ac861ba req-3babcb38-96ac-484e-a617-0a1cf56b17bb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0496314 Nov 15 12:42:00.467235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-13da0f8b-6173-46b5-9cf1-0d303e195783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:00.472746 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-13da0f8b-6173-46b5-9cf1-0d303e195783 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 1097 time: 0.1068401 Nov 15 12:42:00.581883 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-e6259695-7313-4dbd-ab89-87f63101db27 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:00.583516 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-e6259695-7313-4dbd-ab89-87f63101db27 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/networks?id=e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 200 len: 815 time: 0.2621994 Nov 15 12:42:00.640961 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Request body: {'port': {'device_id': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'admin_state_up': True, 'tenant_id': '27402858adce449996a04024b968bae3'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:00.854639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-31451d80-381c-4d12-aa13-a21b147c5824 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:00.857118 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-31451d80-381c-4d12-aa13-a21b147c5824 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=5d7b948b852c4d75927625acca00a4d6&shared=False HTTP/1.1" status: 200 len: 910 time: 0.3546736 Nov 15 12:42:00.867012 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Made reservation on behalf of 27402858adce449996a04024b968bae3 for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:00.873097 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:00.897307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8439273-be2b-4d10-8762-cc12cd81b969 req-c3673c05-5dba-473e-9acb-5914f7405887 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:00.899787 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8439273-be2b-4d10-8762-cc12cd81b969 req-c3673c05-5dba-473e-9acb-5914f7405887 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.1659510 Nov 15 12:42:01.091410 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Allocated IP 172.20.0.7 (e836cde6-4e01-43bc-9750-09587b9bb5d0/65d6a75d-c74e-4d29-a0f1-5b5b6db06715/040c1614-f002-4947-93a6-47ec1e469e42) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:01.102638 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8439273-be2b-4d10-8762-cc12cd81b969 req-8c1481c7-74a8-460b-bc73-bebb146816ef tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1867814 Nov 15 12:42:01.113587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6289bc5-35ae-402e-9e34-4162cd5b1755 req-61c2d93d-111c-438c-8a7d-20c412558b73 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.115174 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c6289bc5-35ae-402e-9e34-4162cd5b1755 req-61c2d93d-111c-438c-8a7d-20c412558b73 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 944 time: 0.0844119 Nov 15 12:42:01.165826 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-99c332c1-5f98-4a5a-b1e3-aeaa1c7d80d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.168594 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-07588f09-a5aa-41bf-a02e-10130c37d97d req-99c332c1-5f98-4a5a-b1e3-aeaa1c7d80d2 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2665997 Nov 15 12:42:01.294111 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c6289bc5-35ae-402e-9e34-4162cd5b1755 req-b6985767-db2d-46ec-9080-3c018a879417 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1665242 Nov 15 12:42:01.372784 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:01.442884 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:01.508111 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670', '9e843abc-71ca-433a-a92b-f035c2503fb4', 'a106f2a9-c144-4b28-9287-b71a667e6786'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:42:01.576262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb21af40-4853-4b04-bc78-fba52b9311c0 req-333a8d19-dee8-4c24-88a7-b117eef9fe4d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.578124 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fb21af40-4853-4b04-bc78-fba52b9311c0 req-333a8d19-dee8-4c24-88a7-b117eef9fe4d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.3954601 Nov 15 12:42:01.581513 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Network e836cde6-4e01-43bc-9750-09587b9bb5d0 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:01.589692 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-662424cf-2591-4a7e-a2c4-a4a7f2edc3ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.590878 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:01.595501 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-662424cf-2591-4a7e-a2c4-a4a7f2edc3ca service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 1097 time: 0.0864830 Nov 15 12:42:01.597517 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:01.607706 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event updated for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:01.653875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4884d9f-4348-42f7-a714-f0985921b150 req-84297cc2-22ee-46a1-ac7f-f5631d41f564 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.656196 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f4884d9f-4348-42f7-a714-f0985921b150 req-84297cc2-22ee-46a1-ac7f-f5631d41f564 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 931 time: 0.1895387 Nov 15 12:42:01.708798 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-70c917e1-38b5-49c4-bf33-c33686042d6b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=09343116-80f7-47b2-97ab-e055673c6092 HTTP/1.1" status: 200 len: 217 time: 0.0829363 Nov 15 12:42:01.739963 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.741280 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:01.804641 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-50432eee-01fb-4438-90e3-edc7920f0654 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1706603 Nov 15 12:42:01.808238 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fb21af40-4853-4b04-bc78-fba52b9311c0 req-acd5c5ad-c3a8-47f8-9ef7-379e86a8a801 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2102923 Nov 15 12:42:01.827077 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f4884d9f-4348-42f7-a714-f0985921b150 req-c1b88fc6-0c38-4b0f-93dc-c009a9bc3087 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1513040 Nov 15 12:42:01.844712 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-5deb0863-1def-4021-835d-480243f174f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:01.845464 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Request body: {'port': {'device_id': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:01.847570 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-5deb0863-1def-4021-835d-480243f174f8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=9c262ff8-39d2-4560-8a17-db7d1bd0eb4f HTTP/1.1" status: 200 len: 849 time: 0.1209629 Nov 15 12:42:01.922787 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-cb379ce6-e04f-40f2-ab4b-b2b2d227c2f4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=29de8c58-f293-40d7-a944-86383e773ce7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0557618 Nov 15 12:42:01.973262 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:02.030942 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9ee6042d-0234-4720-8aa3-b1782096594e up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:02.135318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 9ee6042d-0234-4720-8aa3-b1782096594e completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:42:02.147026 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-482092b3-d5f8-4543-a823-1ab3a220c110 service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1692190 Nov 15 12:42:02.149478 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 9ee6042d-0234-4720-8aa3-b1782096594e triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:02.150067 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:02.336167 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:02.402858 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:02.406593 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cedc387b-1f8a-4e6c-b22b-cfc3270b6d7b" -d '{"events": [{"server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "name": "network-vif-plugged", "status": "completed", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:02.418510 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40269095-410d-414d-bd8a-fda42c9e7ba6 req-2773cdec-1338-4dbe-ac00-5e6d3b083564 service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2476447 Nov 15 12:42:02.443165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9ee6042d-0234-4720-8aa3-b1782096594e,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:02.450855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:02.551005 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:02.569961 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fe82d0-722d-4548-bf8f-4ba442bad749 req-df2bd20b-7eec-4399-b465-8e4bb81b44f4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:02.571628 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f5fe82d0-722d-4548-bf8f-4ba442bad749 req-df2bd20b-7eec-4399-b465-8e4bb81b44f4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.1331115 Nov 15 12:42:02.593934 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d389ccdb-c4f2-47ae-9b12-c8c937179428 req-c2bb28e2-ba92-44f9-8b7f-76748d107542 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:02.597037 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d389ccdb-c4f2-47ae-9b12-c8c937179428 req-c2bb28e2-ba92-44f9-8b7f-76748d107542 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0906591 Nov 15 12:42:02.683554 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d389ccdb-c4f2-47ae-9b12-c8c937179428 req-94f489f7-c280-4c61-8f94-c16e3e0c5f67 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748675 Nov 15 12:42:02.732253 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f5fe82d0-722d-4548-bf8f-4ba442bad749 req-2ee988f9-7097-47bf-a41b-8057959dd813 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114218 Nov 15 12:42:02.757985 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87490250-30a8-44ba-b3df-c40fb2bed5b3 x-openstack-request-id: req-87490250-30a8-44ba-b3df-c40fb2bed5b3 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:02.758584 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "name": "network-vif-plugged", "status": "completed", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:02.759160 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-87490250-30a8-44ba-b3df-c40fb2bed5b3 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:02.760160 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e', 'code': 200} Nov 15 12:42:02.912267 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 040c1614-f002-4947-93a6-47ec1e469e42 {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:42:02.929710 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:02.959440 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Transition to ACTIVE for port object 040c1614-f002-4947-93a6-47ec1e469e42 will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:42:02.966991 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:03.098633 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facd8882-f2c5-436e-a0bf-07e0f2fa30ef req-37912831-1ed4-41f7-9cd6-4d4154a02db8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.101916 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facd8882-f2c5-436e-a0bf-07e0f2fa30ef req-37912831-1ed4-41f7-9cd6-4d4154a02db8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0924006 Nov 15 12:42:03.118644 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Pushing event updated for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:03.182847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1af0e5-60d9-4de5-8b88-9546d755cbdc req-91179563-8406-4151-a3b5-3348b06a8850 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.185386 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f1af0e5-60d9-4de5-8b88-9546d755cbdc req-91179563-8406-4151-a3b5-3348b06a8850 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.2048810 Nov 15 12:42:03.187898 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facd8882-f2c5-436e-a0bf-07e0f2fa30ef req-ed17e8ee-7ee2-470d-9a3a-c9f2b2a0c148 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732012 Nov 15 12:42:03.300545 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b3b7b14-9783-482a-912c-ff49400c21bd req-f73a470b-10fb-4a20-a8dd-94b876a96851 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.302783 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8b3b7b14-9783-482a-912c-ff49400c21bd req-f73a470b-10fb-4a20-a8dd-94b876a96851 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 1098 time: 0.0771413 Nov 15 12:42:03.315780 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f1af0e5-60d9-4de5-8b88-9546d755cbdc req-773042ae-089f-4d55-a20f-1bafd35b2320 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0962834 Nov 15 12:42:03.318828 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Attempting to bind port 040c1614-f002-4947-93a6-47ec1e469e42 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:03.319177 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Attempting to bind port 040c1614-f002-4947-93a6-47ec1e469e42 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:03.319563 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Attempting to bind port 040c1614-f002-4947-93a6-47ec1e469e42 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:03.324897 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Port 040c1614-f002-4947-93a6-47ec1e469e42 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:42:03.325293 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Attempting to bind port 040c1614-f002-4947-93a6-47ec1e469e42 on network e836cde6-4e01-43bc-9750-09587b9bb5d0 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:03.331998 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 41, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:03.332356 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Checking segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:03.332728 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Bound using segment: {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:03.333165 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Bound port: 040c1614-f002-4947-93a6-47ec1e469e42, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:03.333516 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:03.359407 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4725e9fb-2692-4719-a08f-ea4e3796b92b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:03.399885 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8b3b7b14-9783-482a-912c-ff49400c21bd req-88fd2959-005e-4ca5-a069-79794724b486 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714607 Nov 15 12:42:03.430847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:03.436596 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=040c1614-f002-4947-93a6-47ec1e469e42,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:03.442480 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:03.489716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.490689 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:03.492965 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] 10.222.0.61 "PUT /v2.0/ports/040c1614-f002-4947-93a6-47ec1e469e42 HTTP/1.1" status: 200 len: 1093 time: 1.6641729 Nov 15 12:42:03.493597 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:03.497296 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab" -d '{"events": [{"name": "network-changed", "server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "tag": "040c1614-f002-4947-93a6-47ec1e469e42"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:03.551025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39871304-c2fb-46a7-893d-e8433fd7e640 service neutron] Pushing event updated for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:03.559054 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fadd9f0e-6c1d-4f18-8bd6-46fecb5e62a8 x-openstack-request-id: req-fadd9f0e-6c1d-4f18-8bd6-46fecb5e62a8 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:03.559452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "tag": "040c1614-f002-4947-93a6-47ec1e469e42", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:03.559800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-fadd9f0e-6c1d-4f18-8bd6-46fecb5e62a8 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:03.560421 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42', 'status': 'completed', 'code': 200} Nov 15 12:42:03.882405 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63a2010a-bcfa-4a61-a5bc-31c49f9f5182 req-b6d27224-3b1d-47cf-b5aa-abef9f6b72cc tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.884243 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63a2010a-bcfa-4a61-a5bc-31c49f9f5182 req-b6d27224-3b1d-47cf-b5aa-abef9f6b72cc tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0949292 Nov 15 12:42:03.934014 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3518f179-7578-4530-8f06-3293342f0674 req-f2fa4523-6f61-4114-9bb1-0e0ca6279965 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:03.942527 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3518f179-7578-4530-8f06-3293342f0674 req-f2fa4523-6f61-4114-9bb1-0e0ca6279965 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.0939672 Nov 15 12:42:04.020273 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3518f179-7578-4530-8f06-3293342f0674 req-34fbb39d-6635-408f-80d7-d0b04a7acbc0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765254 Nov 15 12:42:04.035607 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63a2010a-bcfa-4a61-a5bc-31c49f9f5182 req-daf1aa4f-363f-457c-8944-92933c061cff tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162860 Nov 15 12:42:04.303389 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-84d8c72f-a6d2-4dcc-9bf0-f897d52355de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.304960 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-84d8c72f-a6d2-4dcc-9bf0-f897d52355de service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 1096 time: 0.0527813 Nov 15 12:42:04.453319 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512e34c5-37cf-4b11-8338-f2a06f19fa45 req-bead077b-28b6-436c-8fc5-ab1e4ad2a6c4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.455278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-512e34c5-37cf-4b11-8338-f2a06f19fa45 req-bead077b-28b6-436c-8fc5-ab1e4ad2a6c4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.1482718 Nov 15 12:42:04.526205 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b1c3f7-2ae7-438e-b9b3-e147247d1aa7 req-2e0a7f3b-f206-4860-a2ae-7d9bd147f5de tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.528363 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48b1c3f7-2ae7-438e-b9b3-e147247d1aa7 req-2e0a7f3b-f206-4860-a2ae-7d9bd147f5de tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0805430 Nov 15 12:42:04.531719 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-7e628374-accf-4fe2-a253-396592d504ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.533542 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-7e628374-accf-4fe2-a253-396592d504ac service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=27402858adce449996a04024b968bae3&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1973553 Nov 15 12:42:04.606237 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48b1c3f7-2ae7-438e-b9b3-e147247d1aa7 req-b250eee8-eebc-41d4-a8cc-8c9e80440233 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689683 Nov 15 12:42:04.636020 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-512e34c5-37cf-4b11-8338-f2a06f19fa45 req-996d7206-d49f-43ec-959e-47af94f584bf tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1656530 Nov 15 12:42:04.711045 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-110c17b5-4f9f-41e3-bc6a-8b9f595785dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.712597 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d53ccae8-7cd2-42cd-8958-cfa38c44ceab req-110c17b5-4f9f-41e3-bc6a-8b9f595785dd service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1629870 Nov 15 12:42:04.909606 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-dc8e2b64-3629-4bdc-bbe0-77502d09d882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:04.911440 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-dc8e2b64-3629-4bdc-bbe0-77502d09d882 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=27402858adce449996a04024b968bae3&device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 1096 time: 0.0605688 Nov 15 12:42:04.974547 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-c3fb64cf-8cc3-49f1-a65c-4661511f89ad service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=040c1614-f002-4947-93a6-47ec1e469e42 HTTP/1.1" status: 200 len: 217 time: 0.0369663 Nov 15 12:42:05.046251 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-5ab87fc6-3bf1-490e-8aa0-bb8b4d15b54e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:05.048103 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-5ab87fc6-3bf1-490e-8aa0-bb8b4d15b54e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 200 len: 855 time: 0.0628402 Nov 15 12:42:05.100706 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-2e796efb-ff64-4c22-9417-bff5039de2f6 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=e836cde6-4e01-43bc-9750-09587b9bb5d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0387716 Nov 15 12:42:05.230593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793b860d-3c59-433c-99d9-170aefdcaa21 req-f2bd9dc4-1ca6-4823-9fba-c02389a33c5c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:05.232219 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-793b860d-3c59-433c-99d9-170aefdcaa21 req-f2bd9dc4-1ca6-4823-9fba-c02389a33c5c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0844510 Nov 15 12:42:05.233497 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f97b0f-7a9d-4ca4-a1e9-e1d48c535575 req-b1434b0d-dfc4-4eff-97f0-4ccab257c45a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:05.236104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-70f97b0f-7a9d-4ca4-a1e9-e1d48c535575 req-b1434b0d-dfc4-4eff-97f0-4ccab257c45a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.1206832 Nov 15 12:42:05.308334 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-1efdab71-6c26-4148-b2fc-8f8b796f0dcb service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1943333 Nov 15 12:42:05.331338 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-70f97b0f-7a9d-4ca4-a1e9-e1d48c535575 req-5ef61c5b-261c-451b-832e-7bb31e672d78 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809360 Nov 15 12:42:05.364886 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-793b860d-3c59-433c-99d9-170aefdcaa21 req-cc1b4977-7418-4aa6-b1c5-5168720b95a4 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1174300 Nov 15 12:42:05.510649 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-666decc0-bfd3-4aa0-beb9-077bacc79bae req-bcb18af4-8b47-4aee-86eb-0fe6001581a5 service neutron] 10.222.0.61 "GET /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1778917 Nov 15 12:42:05.706354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51262) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:05.753945 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-526ec403-a37e-46f8-9c0e-036ce6603424 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:05.821896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfa51fa-cc79-46ba-96db-7f3e374ecaff req-31598979-d516-417c-b2dc-78906ee5d0b2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:05.825289 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bcfa51fa-cc79-46ba-96db-7f3e374ecaff req-31598979-d516-417c-b2dc-78906ee5d0b2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1084290 Nov 15 12:42:05.827103 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8415652-955e-4d81-975f-db9b65c2c5a2 req-40300ecc-8cf5-40f2-a8f1-c0a74fee7152 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:05.829346 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c8415652-955e-4d81-975f-db9b65c2c5a2 req-40300ecc-8cf5-40f2-a8f1-c0a74fee7152 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0997782 Nov 15 12:42:05.896353 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bcfa51fa-cc79-46ba-96db-7f3e374ecaff req-d125ed35-a67c-4dab-a520-28a6b7b290dc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581169 Nov 15 12:42:05.915685 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c8415652-955e-4d81-975f-db9b65c2c5a2 req-5666ae00-c589-493f-9c10-1ecaf4fbd8e5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783994 Nov 15 12:42:05.983467 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0000b9f6-e93a-4c1b-b1ef-d6a1e4a11104 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.089100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0000b9f6-e93a-4c1b-b1ef-d6a1e4a11104 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.094194 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0000b9f6-e93a-4c1b-b1ef-d6a1e4a11104 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.141399 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-0000b9f6-e93a-4c1b-b1ef-d6a1e4a11104 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=009f86af28214761a463d4e00da6251a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4335446 Nov 15 12:42:06.143640 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0000b9f6-e93a-4c1b-b1ef-d6a1e4a11104 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ba45a8b-862d-4574-8435-56409367b005,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:06.145005 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51268) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:06.205990 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.239504 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.291100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.294262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:06.295740 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6ba45a8b-862d-4574-8435-56409367b005 HTTP/1.1" status: 204 len: 168 time: 0.1492321 Nov 15 12:42:06.309620 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33b3278-8d6c-4069-a3dd-2d3a8236d439 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ba45a8b-862d-4574-8435-56409367b005,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:06.525108 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39643895-faee-4b52-b456-e9e09e25348c req-f14138a7-d3c3-471b-835c-69bc814b413f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:06.527748 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-39643895-faee-4b52-b456-e9e09e25348c req-f14138a7-d3c3-471b-835c-69bc814b413f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.0867212 Nov 15 12:42:06.587572 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfffe56-2f2a-46fd-acf3-f04a25a913cc req-c8560116-723d-41f1-a608-b600c8f87e47 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:06.599178 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bbfffe56-2f2a-46fd-acf3-f04a25a913cc req-c8560116-723d-41f1-a608-b600c8f87e47 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.1153378 Nov 15 12:42:06.612231 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-39643895-faee-4b52-b456-e9e09e25348c req-d5e450c5-64aa-4539-8223-e6d6861b2c26 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713608 Nov 15 12:42:06.666707 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bbfffe56-2f2a-46fd-acf3-f04a25a913cc req-f1e94a4c-6951-46f9-9811-c7b88e5f1472 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665467 Nov 15 12:42:06.856870 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:07.146036 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f36ee7-91ed-41e3-805c-3416be6c669f req-911599ba-8c0a-4602-9a25-c2ec82bde60e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:07.148915 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-76f36ee7-91ed-41e3-805c-3416be6c669f req-911599ba-8c0a-4602-9a25-c2ec82bde60e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1088097 Nov 15 12:42:07.166247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec2d806-2414-42f6-bd78-532feb52bb4e req-28a41f8f-4763-4ac2-8b11-a68ba12c53df tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:07.168916 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3ec2d806-2414-42f6-bd78-532feb52bb4e req-28a41f8f-4763-4ac2-8b11-a68ba12c53df tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0895855 Nov 15 12:42:07.249838 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-76f36ee7-91ed-41e3-805c-3416be6c669f req-ae1b75f4-4364-4a29-ac26-789e9a62ee63 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852792 Nov 15 12:42:07.263687 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3ec2d806-2414-42f6-bd78-532feb52bb4e req-ab898f79-1893-40d8-abef-b8821b361207 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859025 Nov 15 12:42:07.762785 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:42:07.778249 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96399bc1-13b9-4e71-b6e2-49f36d331366 req-0d52a993-049f-48cd-bdbc-7be7e794cc6c tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:07.780706 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-96399bc1-13b9-4e71-b6e2-49f36d331366 req-0d52a993-049f-48cd-bdbc-7be7e794cc6c tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 944 time: 0.0738297 Nov 15 12:42:07.865846 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-96399bc1-13b9-4e71-b6e2-49f36d331366 req-dd74feab-3613-47cc-8df6-e25e04319652 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737495 Nov 15 12:42:08.021107 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 09343116-80f7-47b2-97ab-e055673c6092 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:42:08.172438 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=09343116-80f7-47b2-97ab-e055673c6092,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:08.186039 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '09343116-80f7-47b2-97ab-e055673c6092', 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7', 'port_id': '09343116-80f7-47b2-97ab-e055673c6092', 'mac_address': 'fa:16:3e:5c:2c:5a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 646, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9c262ff8-39d2-4560-8a17-db7d1bd0eb4f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:42:08.232865 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:08.258978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 09343116-80f7-47b2-97ab-e055673c6092 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:42:08.317412 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=09343116-80f7-47b2-97ab-e055673c6092,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:08.324341 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:08.362604 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:08.411000 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:08.471978 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2a8da7-2aa6-4b4e-9b12-e7d51ca8fe70 req-697003c5-d511-459e-b82e-38e87dc824ba tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:08.472901 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cfc339-a923-4f13-aec2-7ad0373f71b2 req-f15f531a-a4fd-4005-b53b-6b3e9ef7c766 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:08.476231 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2a8da7-2aa6-4b4e-9b12-e7d51ca8fe70 req-697003c5-d511-459e-b82e-38e87dc824ba tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0732276 Nov 15 12:42:08.484439 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-68cfc339-a923-4f13-aec2-7ad0373f71b2 req-f15f531a-a4fd-4005-b53b-6b3e9ef7c766 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0780392 Nov 15 12:42:08.572747 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-68cfc339-a923-4f13-aec2-7ad0373f71b2 req-9ca08e5c-974b-45ef-bf05-95ce6af563a1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862460 Nov 15 12:42:08.597162 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2a8da7-2aa6-4b4e-9b12-e7d51ca8fe70 req-4d87dbca-ff2a-4a7c-9010-ca081e6bfbb4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1060257 Nov 15 12:42:09.049478 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53da3af6-03c4-4ad9-b1f0-4208f24f54da req-7c7f5576-59b7-4e63-8482-923043be0624 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:09.051333 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-53da3af6-03c4-4ad9-b1f0-4208f24f54da req-7c7f5576-59b7-4e63-8482-923043be0624 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0657330 Nov 15 12:42:09.073591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['09343116-80f7-47b2-97ab-e055673c6092'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:42:09.130901 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-53da3af6-03c4-4ad9-b1f0-4208f24f54da req-ecee533b-f036-43b2-83d7-bfe605f2c38a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695374 Nov 15 12:42:09.187180 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:09.750072 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-179d9f27-47de-427c-a11d-8fa213328625 req-34060482-506b-4feb-8c5f-5955dba2669f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:09.753515 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-179d9f27-47de-427c-a11d-8fa213328625 req-34060482-506b-4feb-8c5f-5955dba2669f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0829139 Nov 15 12:42:09.772445 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e716ea-a8bd-4058-9b81-1952bb04003f req-5b44b53d-c710-47dc-84ab-e7b9f3814ea9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:09.774865 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e3e716ea-a8bd-4058-9b81-1952bb04003f req-5b44b53d-c710-47dc-84ab-e7b9f3814ea9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0746646 Nov 15 12:42:09.834765 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-179d9f27-47de-427c-a11d-8fa213328625 req-293ce0c4-26d9-4a6f-84df-bce997e335de tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702856 Nov 15 12:42:09.858155 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e3e716ea-a8bd-4058-9b81-1952bb04003f req-774abeeb-8a26-4a33-9de6-6f75162099d6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749235 Nov 15 12:42:10.303387 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a08f51-6a11-4bdc-a580-1d8c82978433 req-2c8d21f2-7499-4c3b-83fd-2a14232baaf5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:10.306089 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91a08f51-6a11-4bdc-a580-1d8c82978433 req-2c8d21f2-7499-4c3b-83fd-2a14232baaf5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0746198 Nov 15 12:42:10.308436 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51432) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:10.393668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Deleting subnet 87c01f6f-c738-41c5-a2bb-dc0a81bcf412 {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:42:10.403377 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.430430 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91a08f51-6a11-4bdc-a580-1d8c82978433 req-603b5d80-251d-44af-93ee-070e1a13c0d5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1100564 Nov 15 12:42:10.454299 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.500869 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.564329 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.605579 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=87c01f6f-c738-41c5-a2bb-dc0a81bcf412,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:10.611237 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.617572 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d0228ba7-4b2a-4269-880b-af5105913aaa admin admin] 10.222.0.44 "DELETE /v2.0/subnets/87c01f6f-c738-41c5-a2bb-dc0a81bcf412 HTTP/1.1" status: 204 len: 168 time: 0.3076942 Nov 15 12:42:10.621575 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51438) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:10.718366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.825136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.849600 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e670dab-8b1b-4c0b-b957-09ab0f90a7e5']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:10.865015 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6cda2c25-0d50-4d83-ad90-443c53bdace9') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:10.865491 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6cda2c25-0d50-4d83-ad90-443c53bdace9') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:10.880196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.898874 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.908251 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Releasing vlan 627 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:42:10.909397 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:42:10.912109 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:42:11.018662 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.044073 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.049229 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] 10.222.0.44 "DELETE /v2.0/networks/9e670dab-8b1b-4c0b-b957-09ab0f90a7e5 HTTP/1.1" status: 204 len: 168 time: 0.4263093 Nov 15 12:42:11.052102 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87aecc7a-3411-47fa-b28f-63246d812bed admin admin] Pushing event deleted for resources: {'Network': ['ID=9e670dab-8b1b-4c0b-b957-09ab0f90a7e5,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:11.053166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51444) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:11.066710 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc9ac8-1a41-4afb-a894-227ec3f99a77 req-d97bc8c3-82b9-4db7-a12d-c4db87adf0d2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:11.069009 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d6cc9ac8-1a41-4afb-a894-227ec3f99a77 req-d97bc8c3-82b9-4db7-a12d-c4db87adf0d2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1135559 Nov 15 12:42:11.136198 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Deleting subnet e133d329-6421-43a8-9f84-6ef51bb648e6 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:42:11.140707 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d6cc9ac8-1a41-4afb-a894-227ec3f99a77 req-54e7e913-5011-4d37-b237-43c7a68a1986 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627759 Nov 15 12:42:11.142651 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.193689 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.250274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.312742 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36179be5-f481-4cb9-8620-fbb6da5481d7 req-43c2aef9-af6f-4915-b385-be3cbe7ab40e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:11.316507 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-36179be5-f481-4cb9-8620-fbb6da5481d7 req-43c2aef9-af6f-4915-b385-be3cbe7ab40e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0893958 Nov 15 12:42:11.326025 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.357590 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e133d329-6421-43a8-9f84-6ef51bb648e6,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:11.363395 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.370473 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-057af7d1-efc8-45f0-ae65-4e2b3c2f8f42 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/e133d329-6421-43a8-9f84-6ef51bb648e6 HTTP/1.1" status: 204 len: 168 time: 0.3119094 Nov 15 12:42:11.370941 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51446) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:11.401292 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-36179be5-f481-4cb9-8620-fbb6da5481d7 req-4252869a-3e29-44e3-ba18-4f59af5ff8e2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772805 Nov 15 12:42:11.462191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.582337 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.608182 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1b84812e-b9f8-41f8-a398-c1800e24b8c5']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:11.621674 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '77de31ed-16f6-4603-8329-20095cae48ee') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:11.621958 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '77de31ed-16f6-4603-8329-20095cae48ee') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:11.637867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78837b3d-6a55-4943-b4ba-9d84d11b4d91 req-d6a5dcd6-b9e2-45d5-8db0-33aed2a4ff22 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:11.639622 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78837b3d-6a55-4943-b4ba-9d84d11b4d91 req-d6a5dcd6-b9e2-45d5-8db0-33aed2a4ff22 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0960674 Nov 15 12:42:11.645592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.679835 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.690694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Releasing vlan 644 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:42:11.691853 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:42:11.694075 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:42:11.765775 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-78837b3d-6a55-4943-b4ba-9d84d11b4d91 req-c5e59757-b191-4a6d-8acf-bb5996ecbe8f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171937 Nov 15 12:42:11.780144 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.786158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:11.792280 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] 10.222.0.44 "DELETE /v2.0/networks/1b84812e-b9f8-41f8-a398-c1800e24b8c5 HTTP/1.1" status: 204 len: 168 time: 0.4196253 Nov 15 12:42:11.807670 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea434d5-1d79-473e-861f-58bbdf14e61f admin admin] Pushing event deleted for resources: {'Network': ['ID=1b84812e-b9f8-41f8-a398-c1800e24b8c5,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:12.080460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51456) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:12.133929 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fe884bd9-6cf1-4478-9e57-24e137c98270 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=ec8daa4ef8d04b26bbcb25140673b521&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0514295 Nov 15 12:42:12.136638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51458) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:12.198983 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:12.224355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:12.295819 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:12.298696 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:12.302431 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/9c596bec-0793-4acc-b674-2a12504b285d HTTP/1.1" status: 204 len: 168 time: 0.1627834 Nov 15 12:42:12.308563 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9284ac32-20a7-481f-be80-ee7d6450e8b9 req-51fd9d2b-1722-46df-842b-f8cf49cf3c3b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:12.310732 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9284ac32-20a7-481f-be80-ee7d6450e8b9 req-51fd9d2b-1722-46df-842b-f8cf49cf3c3b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0713582 Nov 15 12:42:12.311944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f65d4f5-3acc-401a-a744-fb9f392946e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c596bec-0793-4acc-b674-2a12504b285d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:12.378121 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9284ac32-20a7-481f-be80-ee7d6450e8b9 req-cd48e9e8-be73-448c-8e6c-a4e6e0d9bfd6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524056 Nov 15 12:42:12.557420 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a96c251-c513-48f3-a5d3-9281bfae5627 req-987eca8a-d48e-4601-bcaf-d13820b01e92 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:12.559865 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5a96c251-c513-48f3-a5d3-9281bfae5627 req-987eca8a-d48e-4601-bcaf-d13820b01e92 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 943 time: 0.0686209 Nov 15 12:42:12.639860 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5a96c251-c513-48f3-a5d3-9281bfae5627 req-a4515367-1b02-4377-b696-1d765ee86ac6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728836 Nov 15 12:42:12.846667 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51474) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:12.897850 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-cb991040-c43c-449c-b447-d2d4c2cb0904 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=e3bbe3e028624894a8f67c802e671e9b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0495970 Nov 15 12:42:12.902022 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51476) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:12.935080 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29e9dfc-9384-4a79-a781-09c38ac222dc req-1cb84297-9a03-42f0-88ca-519b75af9b74 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:12.937652 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b29e9dfc-9384-4a79-a781-09c38ac222dc req-1cb84297-9a03-42f0-88ca-519b75af9b74 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0627720 Nov 15 12:42:12.985237 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.017194 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b29e9dfc-9384-4a79-a781-09c38ac222dc req-a2743ea1-ecab-4bb7-8418-d4f2badab2b4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700619 Nov 15 12:42:13.027235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.087377 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.092272 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.098218 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/83c00358-94c2-4004-b1ea-987aa29c7694 HTTP/1.1" status: 204 len: 168 time: 0.1908402 Nov 15 12:42:13.098485 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 040c1614-f002-4947-93a6-47ec1e469e42 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:42:13.107371 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b76b9f3-684f-44f8-b187-7002f79a2da6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83c00358-94c2-4004-b1ea-987aa29c7694,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:13.173648 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.291706 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=040c1614-f002-4947-93a6-47ec1e469e42,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:13.312314 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '040c1614-f002-4947-93a6-47ec1e469e42', 'network_id': 'e836cde6-4e01-43bc-9750-09587b9bb5d0', 'port_id': '040c1614-f002-4947-93a6-47ec1e469e42', 'mac_address': 'fa:16:3e:93:ac:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 647, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65d6a75d-c74e-4d29-a0f1-5b5b6db06715', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:42:13.374376 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.394379 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 040c1614-f002-4947-93a6-47ec1e469e42 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:42:13.430030 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=040c1614-f002-4947-93a6-47ec1e469e42,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:13.436157 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:13.520534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:13.581212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c965ac-3743-44a1-b38b-d91dea5fa024 req-16b47d39-5906-4639-b272-9fe2cf6e4b30 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:13.583587 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c7c965ac-3743-44a1-b38b-d91dea5fa024 req-16b47d39-5906-4639-b272-9fe2cf6e4b30 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0972848 Nov 15 12:42:13.672302 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c7c965ac-3743-44a1-b38b-d91dea5fa024 req-f0a0f3af-3f64-405f-bcde-4e9e428525eb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779772 Nov 15 12:42:13.828889 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb635896-4a82-4347-bcc0-05d44ed72972 req-61d8ceb2-acea-4a47-981c-f496cc76978c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:13.831417 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb635896-4a82-4347-bcc0-05d44ed72972 req-61d8ceb2-acea-4a47-981c-f496cc76978c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0720029 Nov 15 12:42:13.908629 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eb635896-4a82-4347-bcc0-05d44ed72972 req-6756ebf6-827c-484f-bdab-77e7679f33c9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686533 Nov 15 12:42:14.199923 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab1c5c0a-cc96-4e46-8648-805b4e2744d9 req-65f627d3-9132-481d-9f8f-b70632c993fe tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:14.203141 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab1c5c0a-cc96-4e46-8648-805b4e2744d9 req-65f627d3-9132-481d-9f8f-b70632c993fe tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0845072 Nov 15 12:42:14.294332 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab1c5c0a-cc96-4e46-8648-805b4e2744d9 req-52779c3b-5e5c-4965-a85c-677a53985ef8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726204 Nov 15 12:42:14.873692 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6c3b07-2bc3-4121-b35c-43e1c01a62ee req-72dffb1c-8507-448b-9406-d0b4ce93c646 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:14.876251 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8d6c3b07-2bc3-4121-b35c-43e1c01a62ee req-72dffb1c-8507-448b-9406-d0b4ce93c646 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0838025 Nov 15 12:42:14.935214 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8d6c3b07-2bc3-4121-b35c-43e1c01a62ee req-b51f7a52-86e0-4343-a0eb-feb9c23cb1ac tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524106 Nov 15 12:42:15.064002 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a22626f-06ad-42f1-bf8e-ba91b06c75d7 req-adc0e7d8-5b40-4742-91ce-e2806e6196dc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:15.065590 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a22626f-06ad-42f1-bf8e-ba91b06c75d7 req-adc0e7d8-5b40-4742-91ce-e2806e6196dc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0533595 Nov 15 12:42:15.127441 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9a22626f-06ad-42f1-bf8e-ba91b06c75d7 req-db730228-2c3d-47f0-ac6e-3e152426e7cf tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523353 Nov 15 12:42:15.436326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2664c17d-2233-4ca0-bb7b-2022fdb54cfd req-ca43cccf-7b4f-40ed-a3ab-e6ed6e72e486 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:15.437808 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2664c17d-2233-4ca0-bb7b-2022fdb54cfd req-ca43cccf-7b4f-40ed-a3ab-e6ed6e72e486 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0523138 Nov 15 12:42:15.505097 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2664c17d-2233-4ca0-bb7b-2022fdb54cfd req-129f46f5-8aed-4a1e-b0a5-e0306045ff48 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547128 Nov 15 12:42:16.082554 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0cf24d-d196-4c87-9223-d496ea700064 req-4ca3b084-3b97-458c-b884-d8270ccebd14 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:16.083992 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc0cf24d-d196-4c87-9223-d496ea700064 req-4ca3b084-3b97-458c-b884-d8270ccebd14 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0650532 Nov 15 12:42:16.133998 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fc0cf24d-d196-4c87-9223-d496ea700064 req-a011eb81-17b8-4512-8649-689ab5cdb70a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438221 Nov 15 12:42:16.263044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b3e778-3031-40b5-863f-e712191bc4e6 req-cb54b56f-7ac8-4aca-b6e4-af16fe412de1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:16.264627 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63b3e778-3031-40b5-863f-e712191bc4e6 req-cb54b56f-7ac8-4aca-b6e4-af16fe412de1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0518012 Nov 15 12:42:16.315259 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63b3e778-3031-40b5-863f-e712191bc4e6 req-65f38d1c-ea91-42d5-ade3-d78314cd9add tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440810 Nov 15 12:42:16.664880 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a12b2ec-e8da-48b0-8d04-8ad041c7fbf1 req-2c7d65fe-3a93-454a-afee-ef43b358d0ae tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:16.666218 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0a12b2ec-e8da-48b0-8d04-8ad041c7fbf1 req-2c7d65fe-3a93-454a-afee-ef43b358d0ae tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0697794 Nov 15 12:42:16.725526 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0a12b2ec-e8da-48b0-8d04-8ad041c7fbf1 req-9c74a4ad-93f3-4b76-b079-e6d415d9edcf tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493953 Nov 15 12:42:17.254576 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c52a66-16ed-4778-87e7-7d0382a15236 req-a323ac38-7a51-47f8-94c7-173600e4bcbd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:17.255489 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63c52a66-16ed-4778-87e7-7d0382a15236 req-a323ac38-7a51-47f8-94c7-173600e4bcbd tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0502734 Nov 15 12:42:17.308793 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63c52a66-16ed-4778-87e7-7d0382a15236 req-fbf26e3b-c045-403f-a0ee-15d4cb7db912 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447500 Nov 15 12:42:17.448146 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d85efe-aef4-406a-b8fc-8e686665e09b req-bc2fd512-4183-40fc-8f60-7b085746ef5c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:17.449739 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-99d85efe-aef4-406a-b8fc-8e686665e09b req-bc2fd512-4183-40fc-8f60-7b085746ef5c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0632961 Nov 15 12:42:17.508108 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-99d85efe-aef4-406a-b8fc-8e686665e09b req-3d5cbcf2-c43c-4032-9e77-b85ddc2b5417 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511565 Nov 15 12:42:17.538593 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['040c1614-f002-4947-93a6-47ec1e469e42'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:42:17.572025 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 09343116-80f7-47b2-97ab-e055673c6092 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:17.664618 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 09343116-80f7-47b2-97ab-e055673c6092 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:42:17.677011 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 09343116-80f7-47b2-97ab-e055673c6092 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:17.677356 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:17.872154 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:17.912178 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09343116-80f7-47b2-97ab-e055673c6092'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:17.916183 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6eb6ebcc-21f4-47a3-9611-0532bd4c98d8" -d '{"events": [{"server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "name": "network-vif-plugged", "status": "completed", "tag": "09343116-80f7-47b2-97ab-e055673c6092"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:17.934931 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1714fed-7b86-44df-b332-66bcb6a25efe req-2eeb16e4-af84-48ae-9ac2-6eeabbcde5f8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:17.943237 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d1714fed-7b86-44df-b332-66bcb6a25efe req-2eeb16e4-af84-48ae-9ac2-6eeabbcde5f8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 945 time: 0.0759976 Nov 15 12:42:17.951047 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=09343116-80f7-47b2-97ab-e055673c6092,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:17.960236 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:17.993530 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba09d042-4de6-4a01-9e7a-9899ec5f8d13 x-openstack-request-id: req-ba09d042-4de6-4a01-9e7a-9899ec5f8d13 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:17.993880 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "name": "network-vif-plugged", "status": "completed", "tag": "09343116-80f7-47b2-97ab-e055673c6092", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:17.994102 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-ba09d042-4de6-4a01-9e7a-9899ec5f8d13 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:17.994800 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '09343116-80f7-47b2-97ab-e055673c6092', 'code': 200} Nov 15 12:42:18.048169 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:18.054319 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d1714fed-7b86-44df-b332-66bcb6a25efe req-9c31bbe7-a142-47c5-9043-ec2e04844f22 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1058941 Nov 15 12:42:18.391126 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9243c4d3-efbf-4b93-9b4e-f44fcdedc91a req-e64cb9e5-b522-4f17-a682-bedbb9683300 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:18.392867 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9243c4d3-efbf-4b93-9b4e-f44fcdedc91a req-e64cb9e5-b522-4f17-a682-bedbb9683300 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 1099 time: 0.1156332 Nov 15 12:42:18.504154 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b582a733-3596-4b15-a305-81cef9e4f4f9 req-8a015b8a-5a82-4cc1-b795-4c46457937a3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:18.505708 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b582a733-3596-4b15-a305-81cef9e4f4f9 req-8a015b8a-5a82-4cc1-b795-4c46457937a3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0823586 Nov 15 12:42:18.581740 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9243c4d3-efbf-4b93-9b4e-f44fcdedc91a req-2545f357-53f0-4759-95f9-686273c93739 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008759 Nov 15 12:42:18.606611 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b582a733-3596-4b15-a305-81cef9e4f4f9 req-19b77e74-711d-4875-b8b1-7b9aea6d3047 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918572 Nov 15 12:42:18.679082 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bbe412-96bb-4825-9821-106174fdf459 req-0e29d189-6723-405d-a60e-04a7760b567c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:18.680719 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-32bbe412-96bb-4825-9821-106174fdf459 req-0e29d189-6723-405d-a60e-04a7760b567c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0577145 Nov 15 12:42:18.739297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-32bbe412-96bb-4825-9821-106174fdf459 req-eadd570d-2cb2-4035-9edb-4bf16ecc6e1f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488508 Nov 15 12:42:19.236621 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34563b-3924-418e-9aa5-926a9f745797 req-66b1a472-c034-4096-b6f6-6f1d7231fea7 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:19.238233 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a34563b-3924-418e-9aa5-926a9f745797 req-66b1a472-c034-4096-b6f6-6f1d7231fea7 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.0725799 Nov 15 12:42:19.326378 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a34563b-3924-418e-9aa5-926a9f745797 req-b7c6c95f-d0c1-48ce-910f-aa09368ebf6d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764809 Nov 15 12:42:19.747697 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b77e929-55c5-4a9c-8699-6be77f2e0e9f req-998844e5-43cc-46f5-9a93-21e7148fa68e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:19.750192 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2b77e929-55c5-4a9c-8699-6be77f2e0e9f req-998844e5-43cc-46f5-9a93-21e7148fa68e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0661900 Nov 15 12:42:19.820936 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2b77e929-55c5-4a9c-8699-6be77f2e0e9f req-71c21591-deba-483a-8d00-741686500129 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624444 Nov 15 12:42:19.885426 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a4d879-f1d7-49b2-9b26-8236be8fbef2 req-23c77332-8cf5-451f-9190-89bdd1f23f70 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:19.887029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-00a4d879-f1d7-49b2-9b26-8236be8fbef2 req-23c77332-8cf5-451f-9190-89bdd1f23f70 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0618806 Nov 15 12:42:19.950105 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-00a4d879-f1d7-49b2-9b26-8236be8fbef2 req-d83e9318-9fad-48cd-b523-286a3c77915b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503490 Nov 15 12:42:20.481831 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d8fcb2-0472-4f71-9023-fa129b077c22 req-af915c7b-2a2e-40ee-bb57-fdf0c781cb40 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:20.483412 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-41d8fcb2-0472-4f71-9023-fa129b077c22 req-af915c7b-2a2e-40ee-bb57-fdf0c781cb40 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.0666726 Nov 15 12:42:20.548919 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-41d8fcb2-0472-4f71-9023-fa129b077c22 req-819729b2-171a-4373-9e08-b458fa9cec7a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582602 Nov 15 12:42:20.957411 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f6950b-b6ed-4e7a-bf90-e488b4b73a7c req-29c3b603-ce95-46dc-9825-6f2785a29a15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:20.958932 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-74f6950b-b6ed-4e7a-bf90-e488b4b73a7c req-29c3b603-ce95-46dc-9825-6f2785a29a15 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0582283 Nov 15 12:42:21.030525 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-74f6950b-b6ed-4e7a-bf90-e488b4b73a7c req-e90b43a7-d7d7-440b-a89a-e30224c612e7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654819 Nov 15 12:42:21.111099 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d664158f-a0dc-4574-b81f-31b68c4ae3d1 req-db5c1daf-2cd4-4539-b6f3-389fcd1ab2e7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:21.112650 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d664158f-a0dc-4574-b81f-31b68c4ae3d1 req-db5c1daf-2cd4-4539-b6f3-389fcd1ab2e7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0708489 Nov 15 12:42:21.188602 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d664158f-a0dc-4574-b81f-31b68c4ae3d1 req-908ac315-09d5-46ab-9555-da2f5a5f7c8e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657094 Nov 15 12:42:21.686427 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6470d1e1-c681-46d6-9fb2-d3551ef26e85 req-4d1f056e-d7b4-40b8-8538-50f3adb80e89 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:21.687850 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6470d1e1-c681-46d6-9fb2-d3551ef26e85 req-4d1f056e-d7b4-40b8-8538-50f3adb80e89 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.0504339 Nov 15 12:42:21.740446 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6470d1e1-c681-46d6-9fb2-d3551ef26e85 req-57fa282a-dc6e-4b2c-9e10-f5a3f5ec1fad tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453334 Nov 15 12:42:22.163616 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991db7e0-71a3-43f3-8e65-4e7044238917 req-8c5494ca-2843-43e3-a88c-bcb2dc1d7ac5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:22.165156 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-991db7e0-71a3-43f3-8e65-4e7044238917 req-8c5494ca-2843-43e3-a88c-bcb2dc1d7ac5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0559418 Nov 15 12:42:22.217588 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-991db7e0-71a3-43f3-8e65-4e7044238917 req-0de19220-3729-44ea-b49d-38229c97976a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461705 Nov 15 12:42:22.317431 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd7a7d6-5b3f-4e06-b598-33ce67ec6f11 req-bb73a19a-70e5-4ba7-a694-5ee0c7a24310 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:22.318879 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dfd7a7d6-5b3f-4e06-b598-33ce67ec6f11 req-bb73a19a-70e5-4ba7-a694-5ee0c7a24310 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.0494146 Nov 15 12:42:22.382277 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dfd7a7d6-5b3f-4e06-b598-33ce67ec6f11 req-fb14c77d-fcec-404e-9dc4-655c8ffba15b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567622 Nov 15 12:42:22.912061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274ae99a-c634-4fc4-bdc9-cb38277c6f63 req-402feb6b-3c5b-4f50-be35-463a6807fd89 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:22.914654 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-274ae99a-c634-4fc4-bdc9-cb38277c6f63 req-402feb6b-3c5b-4f50-be35-463a6807fd89 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.0890658 Nov 15 12:42:23.001982 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-274ae99a-c634-4fc4-bdc9-cb38277c6f63 req-546b897b-734b-492a-af2a-97e0ee2d9d6e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751555 Nov 15 12:42:23.393028 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b2813e-fa20-41ba-9814-fd21679e2b3c req-d6746518-60c1-4fe1-8b0d-0ab9d350284d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:23.396046 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-53b2813e-fa20-41ba-9814-fd21679e2b3c req-d6746518-60c1-4fe1-8b0d-0ab9d350284d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0912170 Nov 15 12:42:23.465128 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-53b2813e-fa20-41ba-9814-fd21679e2b3c req-888df480-5947-4e10-9448-ae66684342e6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571001 Nov 15 12:42:23.545751 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b66fb11-961b-4c59-bd84-604caf34a7a3 req-c80be78c-beae-40f5-8af6-2ecfaba63976 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:23.548241 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8b66fb11-961b-4c59-bd84-604caf34a7a3 req-c80be78c-beae-40f5-8af6-2ecfaba63976 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.0916531 Nov 15 12:42:23.583368 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 040c1614-f002-4947-93a6-47ec1e469e42 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:23.678967 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8b66fb11-961b-4c59-bd84-604caf34a7a3 req-50ba5024-40a3-49e9-aca9-7d2e3b505199 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1177995 Nov 15 12:42:23.693223 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0901e4a7-0ae3-4cf0-807b-308af1337b97 req-e45e34cc-c58e-46ec-a5c4-3812202d9d7b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:23.701819 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0901e4a7-0ae3-4cf0-807b-308af1337b97 req-e45e34cc-c58e-46ec-a5c4-3812202d9d7b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 944 time: 0.1245642 Nov 15 12:42:23.729389 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 040c1614-f002-4947-93a6-47ec1e469e42 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:42:23.735881 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 040c1614-f002-4947-93a6-47ec1e469e42 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:23.736380 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:23.802078 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0901e4a7-0ae3-4cf0-807b-308af1337b97 req-f444e134-41aa-40ee-86ac-36d7d1f44cdb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990570 Nov 15 12:42:23.908502 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:23.960840 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:23.964923 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be97fd4c-ea7c-4e6b-8236-fa5d72b7dbc0" -d '{"events": [{"server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "name": "network-vif-plugged", "status": "completed", "tag": "040c1614-f002-4947-93a6-47ec1e469e42"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:23.987026 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=040c1614-f002-4947-93a6-47ec1e469e42,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:23.993252 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:24.074803 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-435c8bc3-491a-4df0-8e59-daef25177149 x-openstack-request-id: req-435c8bc3-491a-4df0-8e59-daef25177149 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:24.076018 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "name": "network-vif-plugged", "status": "completed", "tag": "040c1614-f002-4947-93a6-47ec1e469e42", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:24.077564 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-435c8bc3-491a-4df0-8e59-daef25177149 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:24.078851 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42', 'code': 200} Nov 15 12:42:24.164203 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:24.200981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51692) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:24.399395 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f79e0e-7f46-42f6-ac77-90407f4703b5 req-9c39d433-f2bc-4fa9-a862-28e4fe7653f6 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:24.401781 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-87f79e0e-7f46-42f6-ac77-90407f4703b5 req-9c39d433-f2bc-4fa9-a862-28e4fe7653f6 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.1434536 Nov 15 12:42:24.498023 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-277e3049-3626-48db-8d89-de68ba5ea717 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:24.525332 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-87f79e0e-7f46-42f6-ac77-90407f4703b5 req-c60bc553-b6bb-4915-ba2c-815aabaa54f9 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046665 Nov 15 12:42:24.588048 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1a17e0-2fc4-4ca5-ab4e-f7a19a535f11 req-1b1064c1-6480-4bd3-92c2-f80ce2f8b005 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:24.589710 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb1a17e0-2fc4-4ca5-ab4e-f7a19a535f11 req-1b1064c1-6480-4bd3-92c2-f80ce2f8b005 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 1098 time: 0.0616751 Nov 15 12:42:24.766130 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb1a17e0-2fc4-4ca5-ab4e-f7a19a535f11 req-862542e5-5fca-4506-bc37-a892dd8618f0 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1447759 Nov 15 12:42:24.770112 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-277e3049-3626-48db-8d89-de68ba5ea717 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:24.779709 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-277e3049-3626-48db-8d89-de68ba5ea717 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:24.798474 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8564e732-7d3d-49dc-a311-8f1e48d1149e req-fa304fa8-c222-4c96-b09c-96f217a3cf21 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:24.800705 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8564e732-7d3d-49dc-a311-8f1e48d1149e req-fa304fa8-c222-4c96-b09c-96f217a3cf21 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1976302 Nov 15 12:42:24.872424 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-277e3049-3626-48db-8d89-de68ba5ea717 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=cc4e88e41b8c4a6a8f770c772998ffa0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6693230 Nov 15 12:42:24.876382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51724) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:24.884362 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277e3049-3626-48db-8d89-de68ba5ea717 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=346d9e9a-af5d-4c86-a956-0027e568e217,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:24.913159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f4486b-da93-4b62-9ea2-b7952cae28ae req-cc3b2244-f8f1-4196-a564-c46240f52b06 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:24.924845 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40f4486b-da93-4b62-9ea2-b7952cae28ae req-cc3b2244-f8f1-4196-a564-c46240f52b06 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1269398 Nov 15 12:42:24.935503 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8564e732-7d3d-49dc-a311-8f1e48d1149e req-78be6a03-f496-41db-bc0a-0f6e788a2be7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1215785 Nov 15 12:42:25.016768 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-40f4486b-da93-4b62-9ea2-b7952cae28ae req-0c9700fe-0d08-4be6-9b73-c6b6afbe079f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0897312 Nov 15 12:42:25.020898 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:25.064003 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:25.099486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd94f230-6a63-4a18-b413-59db3a055944 req-0779c92f-013b-498b-b171-04d8ff4dafe4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:25.101826 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fd94f230-6a63-4a18-b413-59db3a055944 req-0779c92f-013b-498b-b171-04d8ff4dafe4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.0860593 Nov 15 12:42:25.129212 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:25.132434 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:25.134152 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/346d9e9a-af5d-4c86-a956-0027e568e217 HTTP/1.1" status: 204 len: 168 time: 0.2558494 Nov 15 12:42:25.149355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3de843-acc3-43b5-bd88-2744036351c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=346d9e9a-af5d-4c86-a956-0027e568e217,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:25.490557 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fd94f230-6a63-4a18-b413-59db3a055944 req-65525047-502e-4423-806c-1dd92e7546e2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3768179 Nov 15 12:42:25.712252 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815ac9f8-343f-4f8b-8c9c-44869ae49280 req-530a45a0-c9e1-4c98-9f73-ac28262cba45 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:25.714877 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-815ac9f8-343f-4f8b-8c9c-44869ae49280 req-530a45a0-c9e1-4c98-9f73-ac28262cba45 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.0892878 Nov 15 12:42:25.804087 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-815ac9f8-343f-4f8b-8c9c-44869ae49280 req-dbc9b8c2-829e-441d-950c-0c28d79569ff tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778301 Nov 15 12:42:26.179371 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-504a750f-eaf3-44db-a94f-babb4c0f9488 req-622c5639-e084-4d38-9452-27bef94e96c7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:26.183202 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-504a750f-eaf3-44db-a94f-babb4c0f9488 req-622c5639-e084-4d38-9452-27bef94e96c7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1103942 Nov 15 12:42:26.192978 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5ca2b0-6d83-4d21-92ec-d197d87214a5 req-337f41f1-25ca-43e5-a180-8c014110d362 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:26.197257 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cf5ca2b0-6d83-4d21-92ec-d197d87214a5 req-337f41f1-25ca-43e5-a180-8c014110d362 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.0724237 Nov 15 12:42:26.221196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51764) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:26.287424 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-504a750f-eaf3-44db-a94f-babb4c0f9488 req-b8bd74ed-92b0-465d-978c-d85f0d707244 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915227 Nov 15 12:42:26.293572 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cf5ca2b0-6d83-4d21-92ec-d197d87214a5 req-df1552d3-9f3a-40a1-8fb6-a62820ceafb5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0830326 Nov 15 12:42:26.412529 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-77328814-network', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:26.451407 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Made reservation on behalf of df44545940f44d95ad307aa0fea120c4 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:26.455807 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.472962 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.651583 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.659886 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.693128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] vlan segment allocate from pool success with {'vlan_id': 601, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:42:26.700722 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec43787-a59d-441c-83dd-7e1b62890b0d req-ded04c36-1a2f-4c24-9336-f67179bada79 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:26.703761 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cec43787-a59d-441c-83dd-7e1b62890b0d req-ded04c36-1a2f-4c24-9336-f67179bada79 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.0900352 Nov 15 12:42:26.707590 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7af163f1-64de-46c1-89ce-501c6047dc35,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:26.715570 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.716072 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Added segment af347650-18c7-458f-a0a0-a0ae25ae52ca of type vlan for network 63821a5d-1e37-42d5-95f6-37a0a7410c6f Nov 15 12:42:26.798242 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cec43787-a59d-441c-83dd-7e1b62890b0d req-b3334ff4-dd9c-4090-8441-848561036d8f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740397 Nov 15 12:42:26.800506 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.868597 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.869634 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:26.870212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:26.878026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f50f14-d8b5-4343-b8dc-c13bd7a22f73 req-2d434744-a16c-4d67-b9e5-27f2bd81280d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:26.879626 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f7f50f14-d8b5-4343-b8dc-c13bd7a22f73 req-2d434744-a16c-4d67-b9e5-27f2bd81280d service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.0830786 Nov 15 12:42:26.937906 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7134128 Nov 15 12:42:26.943347 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51776) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:26.951873 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Request body: {'subnet': {'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-77328814-subnet', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:26.966029 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0781e3-a4f6-456c-b441-a3772d45bd63 admin admin] Pushing event updated for resources: {'Network': ['ID=63821a5d-1e37-42d5-95f6-37a0a7410c6f,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:26.983487 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:42:27.011630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Made reservation on behalf of df44545940f44d95ad307aa0fea120c4 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:27.018699 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f7f50f14-d8b5-4343-b8dc-c13bd7a22f73 req-360b55bb-68bb-4065-83de-e92dc6d065a6 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1226907 Nov 15 12:42:27.019254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.319910 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.439164 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Pushing event updated for resources: {'Subnet': ['ID=090fdaf0-419e-4969-a548-0e896cf59fa0,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:27.503030 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f8a454-bb20-4078-baf6-50a9b5aef0a6 req-680f3cb8-3727-41fa-9b2c-88a26928c0b4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:27.505491 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6f8a454-bb20-4078-baf6-50a9b5aef0a6 req-680f3cb8-3727-41fa-9b2c-88a26928c0b4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.1131470 Nov 15 12:42:27.507246 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1785ae94-f1de-4ebd-b824-47f72ad8af75 req-53f8fb9f-740c-4b82-9abc-3f3adc7d192a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:27.509799 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1785ae94-f1de-4ebd-b824-47f72ad8af75 req-53f8fb9f-740c-4b82-9abc-3f3adc7d192a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0851741 Nov 15 12:42:27.510201 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Checking segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:27.510646 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Network hostable DHCP agents. Network: 63821a5d-1e37-42d5-95f6-37a0a7410c6f, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:42:27.561210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:42:27.577184 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1785ae94-f1de-4ebd-b824-47f72ad8af75 req-65335057-5be6-455a-ab0d-d1b0b49853ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547087 Nov 15 12:42:27.594985 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 63821a5d-1e37-42d5-95f6-37a0a7410c6f) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:27.608608 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6f8a454-bb20-4078-baf6-50a9b5aef0a6 req-3b6deb6e-ef02-4e11-bed8-e7052c0d35af tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951519 Nov 15 12:42:27.611937 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22607d28-8e68-43ec-9977-b71d37c0f484 None None] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:27.621159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:27.626168 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.673108 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3bbb5dcc-cdeb-408b-9224-a177dcfa1824 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7279127 Nov 15 12:42:27.676858 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51794) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:27.683089 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:27.766934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.769603 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.799240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e108b096-f4aa-4940-b4dd-4171cee1345b req-0df07523-6839-4326-af69-ecb0c3a1ff9b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:27.801782 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e108b096-f4aa-4940-b4dd-4171cee1345b req-0df07523-6839-4326-af69-ecb0c3a1ff9b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1092913 Nov 15 12:42:27.873245 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.891834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:42:27.893900 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:27.991999 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e108b096-f4aa-4940-b4dd-4171cee1345b req-97b32cec-fdb3-4f6b-8b8d-0eed96626cf6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1644869 Nov 15 12:42:28.066016 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5439ca97-561d-4b7a-ba1c-712e149d3a49 req-90e57644-4627-4ac1-94b6-c55fa7dac00d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:28.070685 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5439ca97-561d-4b7a-ba1c-712e149d3a49 req-90e57644-4627-4ac1-94b6-c55fa7dac00d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.1414950 Nov 15 12:42:28.120537 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.167106 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5439ca97-561d-4b7a-ba1c-712e149d3a49 req-add7acc6-9d8a-43a5-986d-afc1341a1bb8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847032 Nov 15 12:42:28.204998 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Allocated IP 172.20.0.2 (63821a5d-1e37-42d5-95f6-37a0a7410c6f/090fdaf0-419e-4969-a548-0e896cf59fa0/3b9f2eb7-e122-4958-aa71-a69abf322351) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:28.490680 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.498256 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.529836 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.545354 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:28.548919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:28.552441 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:28.558344 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.571474 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Pushing event updated for resources: {'Port': ['ID=3b9f2eb7-e122-4958-aa71-a69abf322351,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:28.659074 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Attempting to bind port 3b9f2eb7-e122-4958-aa71-a69abf322351 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:28.659639 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Attempting to bind port 3b9f2eb7-e122-4958-aa71-a69abf322351 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:28.660518 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Attempting to bind port 3b9f2eb7-e122-4958-aa71-a69abf322351 on network 63821a5d-1e37-42d5-95f6-37a0a7410c6f {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:28.669195 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:28.669628 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Checking segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:28.669951 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.672525 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Bound using segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:28.672525 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Bound port: 3b9f2eb7-e122-4958-aa71-a69abf322351, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:28.672525 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.715350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Allocated IP 172.27.0.21 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/46a51869-abfe-44bd-b87c-081fd3737c29) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:28.782398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] For port 3b9f2eb7-e122-4958-aa71-a69abf322351, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:28.790370 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] For port 3b9f2eb7-e122-4958-aa71-a69abf322351, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=3b9f2eb7-e122-4958-aa71-a69abf322351,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:28.797014 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:28.906178 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cf8e24-a78d-4a2b-9b20-c618188943e9 req-7084ed91-d672-417b-a4a8-142113040b2a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:28.910043 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-93cf8e24-a78d-4a2b-9b20-c618188943e9 req-7084ed91-d672-417b-a4a8-142113040b2a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.1082673 Nov 15 12:42:28.915199 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce206707-58ba-4e50-958f-31e53722a8d6 req-c3a1cc5a-7b89-4407-96eb-f70b8c01e420 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:28.917347 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98083b5-9bad-423a-9b09-55409b4d5005 None None] Pushing event updated for resources: {'Port': ['ID=3b9f2eb7-e122-4958-aa71-a69abf322351,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:28.919763 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ce206707-58ba-4e50-958f-31e53722a8d6 req-c3a1cc5a-7b89-4407-96eb-f70b8c01e420 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1952343 Nov 15 12:42:29.001301 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-93cf8e24-a78d-4a2b-9b20-c618188943e9 req-48fc91db-7038-4800-b07b-206d6c2c8d11 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688775 Nov 15 12:42:29.089386 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ce206707-58ba-4e50-958f-31e53722a8d6 req-07d8a370-fbe8-4909-a4ca-e21ba3d29c45 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1536562 Nov 15 12:42:29.099716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:29.166060 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:29.244144 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:29.245948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77412b7c-516a-4409-bd9b-c405eecf71ad req-6efd13d5-723b-4ae6-a896-ee27e86f5984 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:29.253715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:29.259994 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:29.260897 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77412b7c-516a-4409-bd9b-c405eecf71ad req-6efd13d5-723b-4ae6-a896-ee27e86f5984 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1152656 Nov 15 12:42:29.416861 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-77412b7c-516a-4409-bd9b-c405eecf71ad req-ba4a3665-0ccb-4418-b758-3530d4c2223a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1532948 Nov 15 12:42:29.453802 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Pushing event updated for resources: {'Port': ['ID=46a51869-abfe-44bd-b87c-081fd3737c29,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:29.554631 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 3b9f2eb7-e122-4958-aa71-a69abf322351 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:29.591867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768f2d45-2645-4046-abaf-4047da0a30b4 req-bc5b14ce-0fe5-47e0-92d5-aeee5c6824a8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:29.595524 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-768f2d45-2645-4046-abaf-4047da0a30b4 req-bc5b14ce-0fe5-47e0-92d5-aeee5c6824a8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.1872373 Nov 15 12:42:29.631888 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 3b9f2eb7-e122-4958-aa71-a69abf322351 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:29.632373 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:29.750853 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:29.795225 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 3b9f2eb7-e122-4958-aa71-a69abf322351, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=3b9f2eb7-e122-4958-aa71-a69abf322351,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:29.800044 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-768f2d45-2645-4046-abaf-4047da0a30b4 req-70f983c7-dde0-44dd-9366-78bdc656f94f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1965163 Nov 15 12:42:29.817999 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:29.936887 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=3b9f2eb7-e122-4958-aa71-a69abf322351,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:29.962298 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51824) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:29.988350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.462728 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5f10de1-8a9c-4790-8eb1-9e67690fd9f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.515733 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c87bffc-e95d-4eac-937f-813a76de247f req-a60e7e51-da2b-48e6-b86f-8ea985fa252e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:30.517543 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4c87bffc-e95d-4eac-937f-813a76de247f req-a60e7e51-da2b-48e6-b86f-8ea985fa252e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.1799004 Nov 15 12:42:30.568601 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c227b3b1-f4b1-478d-9734-b3e0dc8bb3da req-595f2927-b769-42cf-b1a1-5fd2b560194a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:30.570528 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c227b3b1-f4b1-478d-9734-b3e0dc8bb3da req-595f2927-b769-42cf-b1a1-5fd2b560194a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.2098925 Nov 15 12:42:30.613992 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4c87bffc-e95d-4eac-937f-813a76de247f req-afbf4fcc-c4a1-4628-97d5-6240c34dace8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894899 Nov 15 12:42:30.672997 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.677825 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5f10de1-8a9c-4790-8eb1-9e67690fd9f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.684431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5f10de1-8a9c-4790-8eb1-9e67690fd9f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.704899 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c227b3b1-f4b1-478d-9734-b3e0dc8bb3da req-81eeada0-1eba-4e4f-8028-7abdc3efbea6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1133921 Nov 15 12:42:30.735328 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2955e151-3dfb-40dd-87e7-b92a8b0ea08c None None] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:30.798673 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c5f10de1-8a9c-4790-8eb1-9e67690fd9f6 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=75ec9962b880419795cece318165d795&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8345644 Nov 15 12:42:30.811457 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5f10de1-8a9c-4790-8eb1-9e67690fd9f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b84a208-c5e7-41dc-9a95-da7801e64784,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:30.816087 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51844) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:30.891951 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-5848cbb2-55a6-4e01-bdbb-f616ff792248 None None] Provisioning complete for port 3b9f2eb7-e122-4958-aa71-a69abf322351 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:30.892703 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5848cbb2-55a6-4e01-bdbb-f616ff792248 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.909059 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150ad10e-102f-4291-b46b-53eed5c86787 req-0944d183-1a23-402b-accd-a6f46de2fb95 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:30.911488 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-150ad10e-102f-4291-b46b-53eed5c86787 req-0944d183-1a23-402b-accd-a6f46de2fb95 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2184398 Nov 15 12:42:30.967054 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:30.977623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:42:31.007265 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.084574 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.088231 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.093275 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/9b84a208-c5e7-41dc-9a95-da7801e64784 HTTP/1.1" status: 204 len: 168 time: 0.2600849 Nov 15 12:42:31.132565 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-150ad10e-102f-4291-b46b-53eed5c86787 req-6e15ab9c-d57a-4bc6-b917-ab60d871f06e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2043633 Nov 15 12:42:31.134752 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cd775e-1cb2-4b68-bf7d-5d52397bb9a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b84a208-c5e7-41dc-9a95-da7801e64784,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:31.402091 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 3b9f2eb7-e122-4958-aa71-a69abf322351 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:31.481192 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 3b9f2eb7-e122-4958-aa71-a69abf322351 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:31.481635 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.659248 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:31.680100 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Sync routers for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:31.683831 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-c24a2971-661e-45fc-84ed-7d1a84b7d5d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:31.685574 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-c24a2971-661e-45fc-84ed-7d1a84b7d5d5 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.1106884 Nov 15 12:42:31.704576 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:31.706209 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:31.714133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c3d5ff-03cf-4857-8ecc-e767c6ffafbc req-db735d4b-63bd-4195-ad8f-9ee7a1ca4c48 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:31.718433 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c3c3d5ff-03cf-4857-8ecc-e767c6ffafbc req-db735d4b-63bd-4195-ad8f-9ee7a1ca4c48 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1421833 Nov 15 12:42:31.741778 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.744234 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f4f627d3-319b-4c8c-9c2e-46c929e6cfca admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 4.0660806 Nov 15 12:42:31.749114 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51864) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:31.785989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-b04d3dfd-d902-43a3-acfc-74ec372a7357 None None] Provisioning complete for port 3b9f2eb7-e122-4958-aa71-a69abf322351 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:31.786566 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b04d3dfd-d902-43a3-acfc-74ec372a7357 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:31.902751 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c3c3d5ff-03cf-4857-8ecc-e767c6ffafbc req-84e548fa-75e4-4951-839b-6194985b37ab tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1552722 Nov 15 12:42:31.935134 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:31.948489 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-e1430947-41d2-4d6d-8172-465453a19e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:31.950033 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-e1430947-41d2-4d6d-8172-465453a19e32 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.2272062 Nov 15 12:42:32.100476 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-eb7d455a-222b-4d0b-90d8-adf848f8b4c1 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.0966976 Nov 15 12:42:32.143294 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd814bb-4bd6-45b6-a380-969a87636e5b req-fa176e16-414a-4159-9a43-c222e62ffec7 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:32.157711 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7dd814bb-4bd6-45b6-a380-969a87636e5b req-fa176e16-414a-4159-9a43-c222e62ffec7 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.2427661 Nov 15 12:42:32.213452 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:29Z', 'revision_number': 3, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:32.242447 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-8fd75da5-91a6-4b69-98c9-3f2d8bd8ad85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:32.246749 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-8fd75da5-91a6-4b69-98c9-3f2d8bd8ad85 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.1247096 Nov 15 12:42:32.308112 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Checking router: 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:32.316914 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Updating router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb port 46a51869-abfe-44bd-b87c-081fd3737c29 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:32.348208 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-2626383b-4e52-475e-85d1-8fe4e2678669 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0664084 Nov 15 12:42:32.389486 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:32.394281 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7dd814bb-4bd6-45b6-a380-969a87636e5b req-20457118-6dda-41e5-991e-e3b6fbe2b070 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2341690 Nov 15 12:42:32.478062 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324c0e43-2291-4de9-9c09-176b85ede667 req-ea373f0c-cd99-47a7-85c7-3860b8ee0208 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:32.485970 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-324c0e43-2291-4de9-9c09-176b85ede667 req-ea373f0c-cd99-47a7-85c7-3860b8ee0208 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1366150 Nov 15 12:42:32.609201 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51880) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:32.665146 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-324c0e43-2291-4de9-9c09-176b85ede667 req-d0a6fb84-6bc9-4b02-8bb4-c4e80cdca74a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1779737 Nov 15 12:42:32.679166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-4c80af3a-6787-465f-ae77-5dca2ca6b25f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:32.681881 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-4c80af3a-6787-465f-ae77-5dca2ca6b25f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.1686766 Nov 15 12:42:32.824051 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-1262b241-0087-4700-889c-ec393562723a service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3134477 Nov 15 12:42:32.886328 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-829156122-network', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:32.989886 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.003223 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.037286 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be93c6bb-f027-4447-a0d6-c09d09f6dde6 req-bbc36ddf-75dd-4fd6-8d9f-33c99be93514 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1988432 Nov 15 12:42:33.038924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Made reservation on behalf of ad165f3ffe59498e88611526ef4c254d for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:33.041761 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.106643 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Pushing event updated for resources: {'Port': ['ID=46a51869-abfe-44bd-b87c-081fd3737c29,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:33.138378 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.141495 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.143726 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.147740 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.148527 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.149188 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.153392 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.154627 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.155281 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.155942 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.161093 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.161792 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:33.168526 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.186919 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Attempting to bind port 46a51869-abfe-44bd-b87c-081fd3737c29 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:33.187377 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Attempting to bind port 46a51869-abfe-44bd-b87c-081fd3737c29 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:33.187813 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Attempting to bind port 46a51869-abfe-44bd-b87c-081fd3737c29 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:33.194624 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:33.195228 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:33.195703 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.196183 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:33.196734 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Bound port: 46a51869-abfe-44bd-b87c-081fd3737c29, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:33.197203 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.202923 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ad3d1e-681c-40ec-a19f-5387a3e16e52 req-22be78fd-536e-465f-99a5-c2c91ed79988 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:33.224254 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1ad3d1e-681c-40ec-a19f-5387a3e16e52 req-22be78fd-536e-465f-99a5-c2c91ed79988 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1850121 Nov 15 12:42:33.305425 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] For port 46a51869-abfe-44bd-b87c-081fd3737c29, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:33.318996 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] For port 46a51869-abfe-44bd-b87c-081fd3737c29, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=46a51869-abfe-44bd-b87c-081fd3737c29,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:33.345649 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.351275 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1ad3d1e-681c-40ec-a19f-5387a3e16e52 req-97fc8367-24cb-4422-a99e-61ab722b454f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252770 Nov 15 12:42:33.391743 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-140cd6bd-690b-4cb6-ae67-b149724dcb41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.449595 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:33.450618 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:33.486342 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Deleting port 09343116-80f7-47b2-97ab-e055673c6092 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:42:33.487380 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:33.673377 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b815f73f-d0f4-45dd-b5e1-3dcc6db527b4 None None] Pushing event updated for resources: {'Port': ['ID=46a51869-abfe-44bd-b87c-081fd3737c29,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:33.758346 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:33.890383 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b8783a-edc5-4f2c-b807-940a5f47dff2 req-1e0cc971-5e1f-40e4-94aa-d2ef048ba3e3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:33.903372 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d7b8783a-edc5-4f2c-b807-940a5f47dff2 req-1e0cc971-5e1f-40e4-94aa-d2ef048ba3e3 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 946 time: 0.2818561 Nov 15 12:42:33.971818 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d7b8783a-edc5-4f2c-b807-940a5f47dff2 req-38c2ef47-5836-4b4b-9801-a8df0ce413d5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667789 Nov 15 12:42:34.085282 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.186390 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] For port 09343116-80f7-47b2-97ab-e055673c6092, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=09343116-80f7-47b2-97ab-e055673c6092,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:34.186728 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.230995 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.239089 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d8e1b7-566e-440a-a824-4070df463bd5 req-6b5dbfee-a393-43d8-ba1f-3e4e4a5aac9a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:34.239564 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:29Z', 'revision_number': 3, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:34.240717 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f7d8e1b7-566e-440a-a824-4070df463bd5 req-6b5dbfee-a393-43d8-ba1f-3e4e4a5aac9a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2547014 Nov 15 12:42:34.250593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.255343 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Calling delete_port for 09343116-80f7-47b2-97ab-e055673c6092 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:42:34.275364 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af48c8cf-6d2f-432d-b5cb-1ef62a12c6e5 None None] The sync data for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi is: [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:29Z', 'revision_number': 3, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:42:34.332608 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] vlan segment allocate from pool success with {'vlan_id': 636, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:42:34.395950 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15383770-9ba2-43c3-94ef-2b9b96306017,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:34.445677 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.445945 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Added segment 10a7f5a3-60bf-4073-9982-3736ed07544b of type vlan for network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f Nov 15 12:42:34.536868 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f7d8e1b7-566e-440a-a824-4070df463bd5 req-3a7f3d87-ef6e-4629-a1d2-7a8e74cd691f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2826519 Nov 15 12:42:34.555379 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.569270 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f937d27f-cce6-4912-a3f8-c6c41c1ab1bf req-889ac9af-a25f-415a-85bc-35ee894993bf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:34.584208 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f937d27f-cce6-4912-a3f8-c6c41c1ab1bf req-889ac9af-a25f-415a-85bc-35ee894993bf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1071932 Nov 15 12:42:34.653909 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Allocated IP 172.20.0.1 (63821a5d-1e37-42d5-95f6-37a0a7410c6f/090fdaf0-419e-4969-a548-0e896cf59fa0/c059cff6-5437-48af-86c1-04fb20919292) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:34.729337 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f937d27f-cce6-4912-a3f8-c6c41c1ab1bf req-4d07233d-2228-4df5-8db1-8baa28847ff3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433876 Nov 15 12:42:34.794235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.795995 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:34.796762 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:34.934175 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 2.3229175 Nov 15 12:42:34.939044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51910) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:34.947522 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Request body: {'subnet': {'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-829156122-subnet', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:34.976559 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07ede09-dd33-4fb9-ab0a-fd0393e47b0a admin admin] Pushing event updated for resources: {'Network': ['ID=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:34.990706 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Made reservation on behalf of ad165f3ffe59498e88611526ef4c254d for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:34.996254 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:42:35.003078 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30113338'] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.006313 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.008644 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.046254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Pushing event deleted for resources: {'Port': ['ID=09343116-80f7-47b2-97ab-e055673c6092,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:35.166124 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] No DVR routers for this DVR port 09343116-80f7-47b2-97ab-e055673c6092 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:42:35.170239 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.175166 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5edd8f73-78c8-4504-9a97-42180c5a6380 req-b50928ce-4cb5-444e-8a40-a19b2f7bbeca tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "DELETE /v2.0/ports/09343116-80f7-47b2-97ab-e055673c6092 HTTP/1.1" status: 204 len: 173 time: 2.4772558 Nov 15 12:42:35.178507 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'name': 'network-vif-deleted', 'tag': '09343116-80f7-47b2-97ab-e055673c6092'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:35.180934 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ff1c9f1-a9d8-416e-90df-7febe9a98524" -d '{"events": [{"server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "name": "network-vif-deleted", "tag": "09343116-80f7-47b2-97ab-e055673c6092"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:35.206639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.286890 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-471f244c-89a5-4e33-b06d-027b06086d92 x-openstack-request-id: req-471f244c-89a5-4e33-b06d-027b06086d92 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:35.287338 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fc920a97-c9f8-4ab3-8c59-2adb588e42e5", "name": "network-vif-deleted", "tag": "09343116-80f7-47b2-97ab-e055673c6092", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:35.287739 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-471f244c-89a5-4e33-b06d-027b06086d92 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:35.288404 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fc920a97-c9f8-4ab3-8c59-2adb588e42e5', 'name': 'network-vif-deleted', 'tag': '09343116-80f7-47b2-97ab-e055673c6092', 'status': 'completed', 'code': 200} Nov 15 12:42:35.332779 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f2553604-23cb-4e6c-b12c-94ca51ce4108 req-c88b613f-530f-46f4-ae14-f7973f05d820 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 210 time: 0.1230507 Nov 15 12:42:35.391932 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:35.398858 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:35.405959 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:35.452951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Pushing event updated for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:35.496522 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.496998 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 46a51869-abfe-44bd-b87c-081fd3737c29 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:35.528364 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29998907', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30113320'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.639303 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 46a51869-abfe-44bd-b87c-081fd3737c29 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:35.639948 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.731464 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a6efff2-9e7d-4592-b2fe-44911cde042e,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:35.731989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 09343116-80f7-47b2-97ab-e055673c6092 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:42:35.752069 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:35.752706 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Network hostable DHCP agents. Network: 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:42:35.792771 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 09343116-80f7-47b2-97ab-e055673c6092 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:42:35.793625 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 09343116-80f7-47b2-97ab-e055673c6092 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:42:35.824772 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:42:35.877328 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:35.926716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:35.927892 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.935467 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f6c3f5a-04f5-4ca3-82a5-abd27ea67a6b None None] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:35.939687 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:35.987474 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f7e7412e-3ecd-4f49-92dc-46bc520c5976 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.0457981 Nov 15 12:42:35.990049 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51924) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:35.997082 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:36.015966 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dc8343-203f-44d1-9158-82b4f9480d8d req-e693e623-47cc-4fc2-9b51-0305458a8bc6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:36.018339 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-33dc8343-203f-44d1-9158-82b4f9480d8d req-e693e623-47cc-4fc2-9b51-0305458a8bc6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1739593 Nov 15 12:42:36.023162 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168aa478-0e54-4501-a136-a3fd0a791073 req-6ba94823-29d3-4a60-bfeb-7e9585849e95 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:36.025541 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-168aa478-0e54-4501-a136-a3fd0a791073 req-6ba94823-29d3-4a60-bfeb-7e9585849e95 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1438005 Nov 15 12:42:36.054922 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-976bdb68-f1c7-44eb-a4f6-32c993bfc9f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.065098 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.070403 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.072781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.094403 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-6f90f09e-4469-41a0-9130-be3a397eaa0f None None] Provisioning complete for port c059cff6-5437-48af-86c1-04fb20919292 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:36.094770 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6f90f09e-4469-41a0-9130-be3a397eaa0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.138637 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 46a51869-abfe-44bd-b87c-081fd3737c29, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=46a51869-abfe-44bd-b87c-081fd3737c29,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:36.143704 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-33dc8343-203f-44d1-9158-82b4f9480d8d req-66757588-b85c-4512-a019-7d5d10b556bf tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1064556 Nov 15 12:42:36.169098 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.188765 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-6f90f09e-4469-41a0-9130-be3a397eaa0f None None] Port c059cff6-5437-48af-86c1-04fb20919292 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:36.194252 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.276800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=46a51869-abfe-44bd-b87c-081fd3737c29,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:36.297706 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-168aa478-0e54-4501-a136-a3fd0a791073 req-9b6569dc-526b-47ac-8e7c-92623ae35fc9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2638416 Nov 15 12:42:36.404480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.415944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.426150 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:42:36.427720 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.526875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.626542 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.632012 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Pushing event updated for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:36.697138 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ddf8895c-21d3-4f09-b8d0-6ddceb6a7cba req-147ae3be-5394-43f6-9def-62b4c9ab3f16 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=fc920a97-c9f8-4ab3-8c59-2adb588e42e5 HTTP/1.1" status: 200 len: 210 time: 0.0697031 Nov 15 12:42:36.750491 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Allocated IP 172.20.0.2 (7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f/2a6efff2-9e7d-4592-b2fe-44911cde042e/081bceef-923f-4e85-aba5-adeeda34bdd3) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:36.834801 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:36.836604 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:36.923346 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:36.983157 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.027591 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.102117 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.115192 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.224856 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:37.233426 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:37.238614 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:37.239803 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:42:37.278490 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Allocated IP 172.27.0.137 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/18ef0c61-7468-4e28-958e-8c15da1775b6) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:37.295209 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Pushing event updated for resources: {'Port': ['ID=081bceef-923f-4e85-aba5-adeeda34bdd3,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:37.418406 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Attempting to bind port 081bceef-923f-4e85-aba5-adeeda34bdd3 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:37.419941 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Attempting to bind port 081bceef-923f-4e85-aba5-adeeda34bdd3 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:37.420631 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Attempting to bind port 081bceef-923f-4e85-aba5-adeeda34bdd3 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:37.437578 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e8be1e91-0c0b-4626-a327-fdfbd8056670 None None] Provisioning complete for port c059cff6-5437-48af-86c1-04fb20919292 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:37.438006 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e8be1e91-0c0b-4626-a327-fdfbd8056670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.444372 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:37.444947 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:37.445568 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.446188 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Bound using segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:37.446954 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Bound port: 081bceef-923f-4e85-aba5-adeeda34bdd3, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:37.447556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.489553 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 46a51869-abfe-44bd-b87c-081fd3737c29 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:37.560222 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f51fd08b-a22d-4421-8a96-f345ea4c7832 req-53c1ff13-2e64-4ca2-84ec-ae0e785c992c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:37.561807 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f51fd08b-a22d-4421-8a96-f345ea4c7832 req-53c1ff13-2e64-4ca2-84ec-ae0e785c992c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0975542 Nov 15 12:42:37.583350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.624378 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d80b26-5e05-4f46-9120-6c9072bfb65d req-5be7281a-23b7-4573-b5c9-0de98a184ed2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:37.627055 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-45d80b26-5e05-4f46-9120-6c9072bfb65d req-5be7281a-23b7-4573-b5c9-0de98a184ed2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2019117 Nov 15 12:42:37.627227 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-e8be1e91-0c0b-4626-a327-fdfbd8056670 None None] Port c059cff6-5437-48af-86c1-04fb20919292 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:37.666494 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:37.669871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] For port 081bceef-923f-4e85-aba5-adeeda34bdd3, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:37.676566 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] For port 081bceef-923f-4e85-aba5-adeeda34bdd3, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=081bceef-923f-4e85-aba5-adeeda34bdd3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:37.677402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 46a51869-abfe-44bd-b87c-081fd3737c29 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:37.677834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.682834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.693300 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-60867560-a207-4ee2-8775-b8de98502f5f admin admin] 10.222.0.44 "PUT /v2.0/routers/6ae5861d-cdb6-4c9e-afbb-483dcc64cafb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9399483 Nov 15 12:42:37.694005 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f51fd08b-a22d-4421-8a96-f345ea4c7832 req-8dbe5b32-e2f7-4065-8e89-024b06ec25a6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1166067 Nov 15 12:42:37.756207 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:37.769310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Sync routers for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:37.811688 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-45d80b26-5e05-4f46-9120-6c9072bfb65d req-488f106f-72f4-4b65-a5c4-7fb8b0519287 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1691875 Nov 15 12:42:37.840858 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:37.870729 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:37.878896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:37.881617 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Pushing event updated for resources: {'Port': ['ID=18ef0c61-7468-4e28-958e-8c15da1775b6,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:37.923769 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:37.924033 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:38.224763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10826f5-4c07-4aa7-a48d-34be6cac64c2 None None] Pushing event updated for resources: {'Port': ['ID=081bceef-923f-4e85-aba5-adeeda34bdd3,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:38.461797 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:38.543619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:38.743462 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-c0c9aa7e-2807-4232-97a1-db1b3a0d3b6d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:38.748705 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-c0c9aa7e-2807-4232-97a1-db1b3a0d3b6d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/networks?id=29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 200 len: 809 time: 0.3962841 Nov 15 12:42:38.782810 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-920197d3-5fd8-4016-91e3-8478e9ef3e53 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/quotas/5d7b948b852c4d75927625acca00a4d6 HTTP/1.1" status: 200 len: 375 time: 0.0282991 Nov 15 12:42:38.857308 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-0d37b9bf-e81d-4286-9537-128d1685cc53 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0731633 Nov 15 12:42:38.877073 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.008545 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 2, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:39.018916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51976) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:39.034416 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-945489215-network', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:39.039589 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Checking router: 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:39.040291 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Updating router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb port c059cff6-5437-48af-86c1-04fb20919292 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:39.077207 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.099741 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25a14f6-639d-49c3-9388-5867de3cd104 req-7ab44da8-5f3f-4703-b4d9-c5bc8475f24c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:39.101619 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e25a14f6-639d-49c3-9388-5867de3cd104 req-7ab44da8-5f3f-4703-b4d9-c5bc8475f24c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1319919 Nov 15 12:42:39.112516 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Made reservation on behalf of 9ab16627a6404e7e9735d089a2febe78 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:39.116464 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.149354 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.163472 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.216814 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-685b3b70-890c-4a97-876a-4e117959c263 service neutron] 10.222.0.44 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3580654 Nov 15 12:42:39.276765 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e25a14f6-639d-49c3-9388-5867de3cd104 req-5f25b1c6-0f76-4208-8979-ed4fe3e870a1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1574397 Nov 15 12:42:39.398838 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.411988 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.440208 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.525439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] vlan segment allocate from pool success with {'vlan_id': 639, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:42:39.563621 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f04dbfa8-cb37-4470-9477-7cdec21c826f,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:39.575383 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.576422 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Added segment 162eb35d-70e4-43af-a8e2-2e32e5bf12e0 of type vlan for network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 Nov 15 12:42:39.612712 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 081bceef-923f-4e85-aba5-adeeda34bdd3 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:39.617814 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.618511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.619069 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.619987 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.620199 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.621446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.621446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.621837 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.622301 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.622760 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.623214 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.623656 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:39.696464 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-db50aa90-39c6-4044-8c97-a6c5d4df3e13 service neutron] 10.222.0.44 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4595478 Nov 15 12:42:39.707056 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.761033 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Router 9debd778-08e0-487d-9344-378c464d56b4 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:42:39.816252 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.826443 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:39.827566 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.866898 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6287dc6-d6d8-4659-b07d-84c9a0e05327 None None] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:39.965980 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.9392433 Nov 15 12:42:39.975544 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 51986) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:39.983297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Request body: {'subnet': {'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-945489215-subnet', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:39.986834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] Provisioning complete for port 081bceef-923f-4e85-aba5-adeeda34bdd3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:39.987408 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:39.987688 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:39.997799 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c9bea17-869a-4393-ae3f-66d02429c04e admin admin] Pushing event updated for resources: {'Network': ['ID=d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:40.006122 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:40.027111 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:40.052512 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:40.062165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:42:40.091236 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a08df6-870b-417d-af34-465cba11eb24 req-f9ca78b6-4ca6-45c0-9ec6-e0b703fcbee6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:40.107767 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8a08df6-870b-417d-af34-465cba11eb24 req-f9ca78b6-4ca6-45c0-9ec6-e0b703fcbee6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.2570965 Nov 15 12:42:40.133446 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.140499 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-0deb41d2-0817-46dc-9ca6-a5b53c516ae2 admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.1467957 Nov 15 12:42:40.141486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 51994) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:40.177387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Made reservation on behalf of 9ab16627a6404e7e9735d089a2febe78 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:40.181291 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.328983 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:40.465831 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 081bceef-923f-4e85-aba5-adeeda34bdd3 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:40.466640 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.497698 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f080887d-d801-49e0-ab3f-95cf82cba380 req-404514bb-c66a-40b8-a212-b23df738696b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.3268940 Nov 15 12:42:40.548246 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a8a08df6-870b-417d-af34-465cba11eb24 req-9be3d2fb-c273-4f3d-8050-8ec7be1420be tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4387057 Nov 15 12:42:40.748685 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.842733 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.868455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:40.886271 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:38Z', 'revision_number': 3, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:40.935412 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:40.935883 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Updating router 9debd778-08e0-487d-9344-378c464d56b4 port 18ef0c61-7468-4e28-958e-8c15da1775b6 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:40.975428 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.033816 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] For port 081bceef-923f-4e85-aba5-adeeda34bdd3, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=081bceef-923f-4e85-aba5-adeeda34bdd3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:41.113110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.178287 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.301919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Attempting to bind port c059cff6-5437-48af-86c1-04fb20919292 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:41.303277 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Attempting to bind port c059cff6-5437-48af-86c1-04fb20919292 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:41.303813 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Attempting to bind port c059cff6-5437-48af-86c1-04fb20919292 on network 63821a5d-1e37-42d5-95f6-37a0a7410c6f {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:41.307093 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f14b96-017c-4d56-a192-a0c83b1d3d93 None None] Pushing event updated for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:41.349322 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6efd7478-ea59-4576-b80a-5a4beb76d983,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:41.386089 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Checking segment: {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:41.387103 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Network hostable DHCP agents. Network: d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:42:41.429826 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e8b460-002d-4e22-905d-1c7a707b1a40 None None] Pushing event updated for resources: {'Port': ['ID=081bceef-923f-4e85-aba5-adeeda34bdd3,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:41.446123 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:42:41.452656 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:41.453181 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Checking segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:41.454911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.455502 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Bound using segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:41.459073 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Bound port: c059cff6-5437-48af-86c1-04fb20919292, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:41.459810 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.474982 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:41.481273 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:41.482355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.520618 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-68223461-3f1c-4503-887c-9b44e8efd4e8 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.5421467 Nov 15 12:42:41.521358 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52018) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:41.529742 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:41.586746 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9dd45bd-0569-4afc-8fe0-1a11701c182e None None] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:41.613409 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.615036 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.782990 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:41.848085 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b024009d-5eb9-4039-be58-74b1890db538 req-ad5ba5f9-2487-49ac-883c-a1ba49f71f8f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.0624833 Nov 15 12:42:41.973303 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] For port c059cff6-5437-48af-86c1-04fb20919292, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:41.973303 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] For port c059cff6-5437-48af-86c1-04fb20919292, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c059cff6-5437-48af-86c1-04fb20919292,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:42.012269 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.019931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] Provisioning complete for port c059cff6-5437-48af-86c1-04fb20919292 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:42.019931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.197086 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.254489 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.268783 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.365802 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Attempting to bind port 18ef0c61-7468-4e28-958e-8c15da1775b6 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:42.366375 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Attempting to bind port 18ef0c61-7468-4e28-958e-8c15da1775b6 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:42.366963 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Attempting to bind port 18ef0c61-7468-4e28-958e-8c15da1775b6 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:42.459240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7ee986-5e04-4fe5-afad-9295d36f4c74 req-2cf5482f-16b3-481f-b2fa-1906ac917229 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:42.464744 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a7ee986-5e04-4fe5-afad-9295d36f4c74 req-2cf5482f-16b3-481f-b2fa-1906ac917229 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.4874778 Nov 15 12:42:42.477463 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:42.485190 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:42.486020 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.486714 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:42.487536 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Bound port: 18ef0c61-7468-4e28-958e-8c15da1775b6, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:42.488213 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.575925 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a7ee986-5e04-4fe5-afad-9295d36f4c74 req-a00f7936-2b03-48c0-bad3-725327d6f585 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0954874 Nov 15 12:42:42.579093 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.585541 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] For port 18ef0c61-7468-4e28-958e-8c15da1775b6, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:42.591948 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] For port 18ef0c61-7468-4e28-958e-8c15da1775b6, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=18ef0c61-7468-4e28-958e-8c15da1775b6,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:42.610196 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.659690 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082e1c81-2d49-490a-b83e-9824653f94f0 None None] Pushing event updated for resources: {'Port': ['ID=18ef0c61-7468-4e28-958e-8c15da1775b6,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:42.669904 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f14b96-017c-4d56-a192-a0c83b1d3d93 None None] Pushing event updated for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:42.678524 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'fixed_ips': [{'subnet_id': '6efd7478-ea59-4576-b80a-5a4beb76d983'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:42:42.680423 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:42.690403 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:42.691955 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:42.719087 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:42.720017 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:42.989841 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Allocated IP 172.20.0.1 (7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f/2a6efff2-9e7d-4592-b2fe-44911cde042e/987bb19a-6a1a-4482-b727-c4a8e9b2f55c) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:43.143606 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082e1c81-2d49-490a-b83e-9824653f94f0 None None] Pushing event updated for resources: {'Port': ['ID=18ef0c61-7468-4e28-958e-8c15da1775b6,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:43.167714 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:43.247570 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-181d5319-dce3-4ee8-aec6-6cd5ed29d77f req-fa535b19-49a5-4915-9e70-b76e49464829 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.1515915 Nov 15 12:42:43.298658 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:43.303150 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.360964 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.467320 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.537298 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] For port c059cff6-5437-48af-86c1-04fb20919292, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c059cff6-5437-48af-86c1-04fb20919292,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:43.560514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 081bceef-923f-4e85-aba5-adeeda34bdd3 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:43.570392 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.599919 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.749864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.765457 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Pushing event updated for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:43.780331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:43.790968 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:43.807391 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.810768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.813176 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.813690 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.814221 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.814837 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.815412 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.815995 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.819838 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.820736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.821492 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.822451 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:42:43.824756 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:38Z', 'revision_number': 3, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:43.842346 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:43.852499 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:43.868659 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aac6cb7-5cd8-4fe7-9e8e-dc177d4be4f2 None None] Pushing event updated for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:43.879705 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f28badba-c3c0-4d4b-b479-54d4e420e81f None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:38Z', 'revision_number': 3, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:42:44.054587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:44.070679 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b0e1e6-744b-4a80-a976-b0b5fd740bd8 req-83a99ba0-14cb-4e82-a8b6-b0be24fa4cb5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:44.073666 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f2b0e1e6-744b-4a80-a976-b0b5fd740bd8 req-83a99ba0-14cb-4e82-a8b6-b0be24fa4cb5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2239285 Nov 15 12:42:44.174578 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-12295c68-0695-48db-9d97-c0810cabfb4a None None] Provisioning complete for port 081bceef-923f-4e85-aba5-adeeda34bdd3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:44.176208 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-12295c68-0695-48db-9d97-c0810cabfb4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:44.190814 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Allocated IP 172.20.0.2 (d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6/6efd7478-ea59-4576-b80a-5a4beb76d983/627d232e-598f-447d-b086-8c7a0a11aea5) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:44.196798 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Allocated IP 172.27.0.235 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/23721e28-1c53-411d-bdd5-b7abe13ce659) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:44.380732 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f2b0e1e6-744b-4a80-a976-b0b5fd740bd8 req-0b3f8eb1-3b9b-4502-b7db-4156efe23eed tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2079597 Nov 15 12:42:44.457612 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 081bceef-923f-4e85-aba5-adeeda34bdd3 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:44.458966 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:44.751220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:44.809163 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:42:44.845034 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:44.953884 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef0d562f-93ce-40d2-b483-a44288f442ab req-9108891d-83ed-4b0a-bb00-6bd0e293b49b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.1393523 Nov 15 12:42:45.148864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.151907 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-1b015377-dabe-4571-a27f-69358501031c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:45.154737 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-1b015377-dabe-4571-a27f-69358501031c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1098 time: 0.2055471 Nov 15 12:42:45.273000 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-12295c68-0695-48db-9d97-c0810cabfb4a None None] Provisioning complete for port c059cff6-5437-48af-86c1-04fb20919292 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:45.274101 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-12295c68-0695-48db-9d97-c0810cabfb4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.318426 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-4de40b36-27f2-4924-911b-a79b9765582e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:45.321252 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-4de40b36-27f2-4924-911b-a79b9765582e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "GET /v2.0/networks?id=29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 200 len: 809 time: 0.5467978 Nov 15 12:42:45.471157 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Request body: {'port': {'device_id': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7', 'admin_state_up': True, 'tenant_id': '5d7b948b852c4d75927625acca00a4d6'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:45.502219 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 18ef0c61-7468-4e28-958e-8c15da1775b6 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:45.544494 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:41Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:45.612973 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.641091 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.645020 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e767c77c-8642-44e1-8077-e81a8ff497f7 None None] The sync data for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi is: [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:41Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:42:45.659011 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:45.708751 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:45.714799 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:45.735495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.790168 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:45.809998 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-a1371262-73a7-4e9b-909e-e3ddf88fb5b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:45.811534 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-a1371262-73a7-4e9b-909e-e3ddf88fb5b3 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.6036558 Nov 15 12:42:45.880389 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Pushing event updated for resources: {'Port': ['ID=23721e28-1c53-411d-bdd5-b7abe13ce659,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:45.964697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Pushing event updated for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:45.979289 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.153088 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:46.154949 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Pushing event updated for resources: {'Port': ['ID=627d232e-598f-447d-b086-8c7a0a11aea5,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:46.169252 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:46.181604 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:46.221485 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72192662-1bb5-4dcc-b923-bbd87c59f4e1 req-ce7c538b-b287-4425-ac33-6082c91f8158 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:46.223526 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-72192662-1bb5-4dcc-b923-bbd87c59f4e1 req-ce7c538b-b287-4425-ac33-6082c91f8158 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.5627820 Nov 15 12:42:46.281029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ead55bf8-5ba9-47a3-9b05-727ea8b35239 req-9a7d8ddc-58a2-4c23-a54f-347eeace96e6 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.0965686 Nov 15 12:42:46.301121 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-3a9a13d8-dc87-47a4-ac4c-6e64585026ab service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 1001 time: 0.4429116 Nov 15 12:42:46.342509 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Attempting to bind port 627d232e-598f-447d-b086-8c7a0a11aea5 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:46.343361 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Attempting to bind port 627d232e-598f-447d-b086-8c7a0a11aea5 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:46.343661 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Attempting to bind port 627d232e-598f-447d-b086-8c7a0a11aea5 on network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:46.347318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 18ef0c61-7468-4e28-958e-8c15da1775b6 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:46.347913 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.433190 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:46.433786 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Checking segment: {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:46.434417 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.435046 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Bound using segment: {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:46.435858 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Bound port: 627d232e-598f-447d-b086-8c7a0a11aea5, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:46.436506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.472248 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:46.478216 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:46.484848 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-eac34081-a493-4bab-a448-9a68925bd41c None None] Provisioning complete for port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:46.485454 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-eac34081-a493-4bab-a448-9a68925bd41c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.596684 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.599614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Made reservation on behalf of 5d7b948b852c4d75927625acca00a4d6 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:46.612619 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.619078 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-eac34081-a493-4bab-a448-9a68925bd41c None None] Port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:46.860800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:46.884196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-bc434ce3-e729-4d7a-b6fb-4579696beb6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:46.886242 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-bc434ce3-e729-4d7a-b6fb-4579696beb6e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.4834836 Nov 15 12:42:46.891616 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:42:46.976591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 18ef0c61-7468-4e28-958e-8c15da1775b6, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=18ef0c61-7468-4e28-958e-8c15da1775b6,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:46.979774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] For port 627d232e-598f-447d-b086-8c7a0a11aea5, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:46.987750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] For port 627d232e-598f-447d-b086-8c7a0a11aea5, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=627d232e-598f-447d-b086-8c7a0a11aea5,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:46.989760 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:47.109943 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-72192662-1bb5-4dcc-b923-bbd87c59f4e1 req-84fc6051-3c8d-463f-9823-f2eb26baf5df tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.8622649 Nov 15 12:42:47.119918 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=18ef0c61-7468-4e28-958e-8c15da1775b6,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:47.126440 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:47.211073 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Allocated IP 172.20.0.9 (29de8c58-f293-40d7-a944-86383e773ce7/9c262ff8-39d2-4560-8a17-db7d1bd0eb4f/e7e580cd-1661-4485-bb46-67ecab8410ac) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:47.267089 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:47.273937 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-aa8c748d-18d5-45a1-a468-73afd10a1805 admin admin] 10.222.0.44 "PUT /v2.0/routers/9debd778-08e0-487d-9344-378c464d56b4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1257720 Nov 15 12:42:47.344692 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-f989d7b7-f9c3-4b02-bbb3-90980e92d7eb None None] Provisioning complete for port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:47.345539 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f989d7b7-f9c3-4b02-bbb3-90980e92d7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:47.349726 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b98da5a-ac74-4650-865f-33beb79e6bcc None None] Pushing event updated for resources: {'Port': ['ID=627d232e-598f-447d-b086-8c7a0a11aea5,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:47.351235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-fb4d7d4b-15a2-4dac-ae45-a6fab7569982 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:47.357764 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-fb4d7d4b-15a2-4dac-ae45-a6fab7569982 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4313526 Nov 15 12:42:47.383797 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:47.547975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-f989d7b7-f9c3-4b02-bbb3-90980e92d7eb None None] Port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:47.588162 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6faf8a6b-dd6e-4719-8a90-7ffd03ec517c req-6c161834-c06e-4af6-b989-6839ca823196 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.0558538 Nov 15 12:42:47.715230 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-6a960c38-31ac-4222-9b04-0e09a72ddb58 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3393505 Nov 15 12:42:47.812561 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c059cff6-5437-48af-86c1-04fb20919292 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:47.921340 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:47.979321 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:47.980541 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:47.989890 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-093bf126-7cd9-48fb-89f3-0a008b8e1bbb req-90786b6d-dc85-4221-b06f-68050cee8946 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2576869 Nov 15 12:42:48.135900 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108286) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:42:48.153385 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.181398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:48.276561 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port c059cff6-5437-48af-86c1-04fb20919292 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:48.277607 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.406563 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.564600 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Network 29de8c58-f293-40d7-a944-86383e773ce7 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:48.579594 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c315e9ec-6ab9-41e2-bef7-5e70a2a291ea req-3833f87e-6a26-43c5-8ad7-b6ea4f98956a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:48.580468 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:48.586648 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:48.596993 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c315e9ec-6ab9-41e2-bef7-5e70a2a291ea req-3833f87e-6a26-43c5-8ad7-b6ea4f98956a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1853957 Nov 15 12:42:48.692561 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 18ef0c61-7468-4e28-958e-8c15da1775b6 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:48.717166 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c315e9ec-6ab9-41e2-bef7-5e70a2a291ea req-31043d30-7856-4a22-9c9c-99dac8d8548d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1159680 Nov 15 12:42:48.743705 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:48.744725 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.787655 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Pushing event updated for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:48.848490 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:45Z', 'revision_number': 2, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:48.876067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 52118) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:48.884922 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-642166694-network', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:48.890986 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:48.892268 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Updating router 9debd778-08e0-487d-9344-378c464d56b4 port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:48.900506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 18ef0c61-7468-4e28-958e-8c15da1775b6 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:48.900983 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.931143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Made reservation on behalf of b86de3bb49114d96be728d8c8451d18a for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:48.935876 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.966724 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:48.969742 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.147803 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-20244c4c-80d5-47d4-9cca-b0b230202c75 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.7002006 Nov 15 12:42:49.151212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.154820 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:49.157657 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.183464 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Sync routers for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:49.198987 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:49.199603 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:49.213737 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ff79f09-4304-4615-adcb-d0eaf0dfa1d4,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:49.216868 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Request body: {'port': {'device_id': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:49.237071 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] vlan segment allocate from pool success with {'vlan_id': 607, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:42:49.250098 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.250521 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Added segment b9d446ec-d69d-4086-b2dc-ff17004bdb41 of type vlan for network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d Nov 15 12:42:49.261923 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d29ffdfc-e0d3-4b6f-b7db-b4d0a3095303 None None] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:49.295299 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e4ae35-8e01-46a9-8696-a02b346d46f5 req-00692681-0174-4a80-983a-be66b30bebb5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:49.298734 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b0e4ae35-8e01-46a9-8696-a02b346d46f5 req-00692681-0174-4a80-983a-be66b30bebb5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 931 time: 0.5404861 Nov 15 12:42:49.338475 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.351754 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.354202 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-377e5b76-9b6e-4328-b580-fc8704ab758f admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 7.8315458 Nov 15 12:42:49.366703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 52124) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:49.414302 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:49.477152 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b0e4ae35-8e01-46a9-8696-a02b346d46f5 req-653c9747-6535-4785-a3f0-35a4e93a4947 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1591654 Nov 15 12:42:49.484685 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.552558 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.553789 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:49.555551 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.587375 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.7093034 Nov 15 12:42:49.597989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52126) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:49.614507 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] Provisioning complete for port 627d232e-598f-447d-b086-8c7a0a11aea5 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:49.614720 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.619412 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Request body: {'subnet': {'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-642166694-subnet', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:49.690651 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1ce3f8-6151-491e-b315-80240126cd1f admin admin] Pushing event updated for resources: {'Network': ['ID=6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:49.740231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:42:49.864148 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Made reservation on behalf of b86de3bb49114d96be728d8c8451d18a for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:42:49.868056 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:49.936342 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 3, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:49.979398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 627d232e-598f-447d-b086-8c7a0a11aea5 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:49.979627 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Checking router: 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:49.980035 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Updating router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 port 23721e28-1c53-411d-bdd5-b7abe13ce659 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:50.021404 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.082623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ef4517e-a1fb-4a26-8636-f2c8a95bb774 req-be56a352-fea7-4950-b7d8-0f569059f10f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:50.084201 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3ef4517e-a1fb-4a26-8636-f2c8a95bb774 req-be56a352-fea7-4950-b7d8-0f569059f10f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1861823 Nov 15 12:42:50.251436 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.261915 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.270143 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.357792 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 627d232e-598f-447d-b086-8c7a0a11aea5 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:50.359585 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.529415 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56d08d3-7b4e-4343-949f-68e3d76f30de None None] Pushing event updated for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:50.538851 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e7e580cd-1661-4485-bb46-67ecab8410ac {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:42:50.545305 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] For port 627d232e-598f-447d-b086-8c7a0a11aea5, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=627d232e-598f-447d-b086-8c7a0a11aea5,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:50.558715 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.591889 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.623475 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.654777 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3ef4517e-a1fb-4a26-8636-f2c8a95bb774 req-f8b34307-503a-44e0-aff7-161c5b7d1f6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3754432 Nov 15 12:42:50.675470 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=33272a70-5cfb-4c4a-a5ae-771ac2aef484,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:50.772886 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Transition to ACTIVE for port object e7e580cd-1661-4485-bb46-67ecab8410ac will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:42:50.791375 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.795832 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.796269 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Attempting to bind port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:50.797037 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Attempting to bind port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:50.797037 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Attempting to bind port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:50.808590 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:50.808982 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:50.809381 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.809835 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Bound using segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:50.810343 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Bound port: 987bb19a-6a1a-4482-b727-c4a8e9b2f55c, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:50.811635 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.922369 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.935804 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Checking segment: {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:50.936753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Network hostable DHCP agents. Network: 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:42:50.941599 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] For port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:50.959918 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:50.963860 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] For port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:51.093515 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.107502 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Attempting to bind port 23721e28-1c53-411d-bdd5-b7abe13ce659 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:51.108194 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Attempting to bind port 23721e28-1c53-411d-bdd5-b7abe13ce659 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:51.108736 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Attempting to bind port 23721e28-1c53-411d-bdd5-b7abe13ce659 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:51.114169 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b87bc0e-275e-4c8e-9ac0-8a800ab24ccb None None] Pushing event updated for resources: {'Port': ['ID=23721e28-1c53-411d-bdd5-b7abe13ce659,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:51.123801 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:51.124470 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:51.125174 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.125790 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:51.127083 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Bound port: 23721e28-1c53-411d-bdd5-b7abe13ce659, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:51.127284 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.128869 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-fbf4b76d-69d0-4b33-b387-8469f43c5f7b None None] Provisioning complete for port 627d232e-598f-447d-b086-8c7a0a11aea5 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:51.129246 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-fbf4b76d-69d0-4b33-b387-8469f43c5f7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.202261 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Pushing event updated for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:51.249218 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] For port 23721e28-1c53-411d-bdd5-b7abe13ce659, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:51.264025 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] For port 23721e28-1c53-411d-bdd5-b7abe13ce659, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=23721e28-1c53-411d-bdd5-b7abe13ce659,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:51.273512 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.275262 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c164be4-2e37-4d55-a99e-e0c9ca510dc2 None None] Pushing event updated for resources: {'Port': ['ID=627d232e-598f-447d-b086-8c7a0a11aea5,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:51.284261 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Allocated IP 172.20.0.1 (d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6/6efd7478-ea59-4576-b80a-5a4beb76d983/eaaa6061-3a7a-41d0-ac7b-b1f20ee16305) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:51.304385 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:42:51.338127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:51.347687 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:51.348844 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.398996 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4ecb6f0a-b633-43d6-8db6-c49597b67ed1 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.7900863 Nov 15 12:42:51.421778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52142) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:51.438535 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4512ecff-2fcc-461e-94c8-e7c025ffc084 None None] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:51.446112 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:51.447084 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:51.453917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d556a0d9-6e95-421d-9634-6a446dda64df req-def86a82-11d2-48ea-a2bb-139b02ebc1c0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:51.457280 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d556a0d9-6e95-421d-9634-6a446dda64df req-def86a82-11d2-48ea-a2bb-139b02ebc1c0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 943 time: 0.5834203 Nov 15 12:42:51.477600 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:42:51.542065 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.543842 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.565684 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:51.566626 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:51.593759 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Attempting to bind port e7e580cd-1661-4485-bb46-67ecab8410ac on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:51.594422 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Attempting to bind port e7e580cd-1661-4485-bb46-67ecab8410ac by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:51.595027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Attempting to bind port e7e580cd-1661-4485-bb46-67ecab8410ac on network 29de8c58-f293-40d7-a944-86383e773ce7 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:51.616262 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.619644 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b87bc0e-275e-4c8e-9ac0-8a800ab24ccb None None] Pushing event updated for resources: {'Port': ['ID=23721e28-1c53-411d-bdd5-b7abe13ce659,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:51.627905 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Port e7e580cd-1661-4485-bb46-67ecab8410ac on network 29de8c58-f293-40d7-a944-86383e773ce7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:42:51.628458 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Attempting to bind port e7e580cd-1661-4485-bb46-67ecab8410ac on network 29de8c58-f293-40d7-a944-86383e773ce7 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:51.738587 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:51.741750 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Checking segment: {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:51.743447 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Bound using segment: {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:51.745983 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Bound port: e7e580cd-1661-4485-bb46-67ecab8410ac, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75c34c2d-db36-477f-b460-e981d9675cdd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:51.748046 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.778639 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.852768 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:51.866074 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:51.893598 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56d08d3-7b4e-4343-949f-68e3d76f30de None None] Pushing event updated for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:51.925848 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 627d232e-598f-447d-b086-8c7a0a11aea5 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:51.961788 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:52.003574 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:52.012798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:52.030027 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d556a0d9-6e95-421d-9634-6a446dda64df req-f51b724d-229c-483c-89e8-cf2be0296c5a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5138566 Nov 15 12:42:52.122418 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.128331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Pushing event updated for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:52.238363 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.242864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:52.249177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e7e580cd-1661-4485-bb46-67ecab8410ac,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:52.291062 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 3, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:52.321970 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.377990 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:52.500922 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03274b17-0fba-44eb-9444-82d835a18109 None None] The sync data for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi is: [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 3, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:42:52.512024 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] Provisioning complete for port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:52.515181 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.574085 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:52.591981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccd49fc-e6f8-4ed3-9676-3f3dc374c077 req-1ff8642b-3031-4e2f-91b9-99df41855507 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:52.598844 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.600968 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fccd49fc-e6f8-4ed3-9676-3f3dc374c077 req-1ff8642b-3031-4e2f-91b9-99df41855507 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.6363647 Nov 15 12:42:52.607263 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] 10.222.0.61 "PUT /v2.0/ports/e7e580cd-1661-4485-bb46-67ecab8410ac HTTP/1.1" status: 200 len: 1093 time: 3.4018383 Nov 15 12:42:52.613459 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:42:52.623511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad943f0d-b57c-498c-95af-20015e749b65" -d '{"events": [{"name": "network-changed", "server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:42:52.718088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fccd49fc-e6f8-4ed3-9676-3f3dc374c077 req-a1ae4a74-2d24-4441-8131-1d44cb0880a0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1159735 Nov 15 12:42:52.748468 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ff9d07-87a8-43e3-9494-07a746b07277 service neutron] Pushing event updated for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:52.841653 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:52.882311 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-aba09e54-eb2d-4a21-a2dc-922fe1600cc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:52.885243 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-aba09e54-eb2d-4a21-a2dc-922fe1600cc0 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 1096 time: 0.1189137 Nov 15 12:42:53.024924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 627d232e-598f-447d-b086-8c7a0a11aea5 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:53.024924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.202324 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-3f2f73bb-00d3-492b-bbc1-6ca5fc252289 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e7e580cd-1661-4485-bb46-67ecab8410ac HTTP/1.1" status: 200 len: 217 time: 0.2003665 Nov 15 12:42:53.382655 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.391298 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.398806 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.402880 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:42:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cffb124-c7f4-486a-a4b0-c6233be28dcf x-openstack-request-id: req-3cffb124-c7f4-486a-a4b0-c6233be28dcf {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:42:53.403167 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:42:53.403483 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-3cffb124-c7f4-486a-a4b0-c6233be28dcf {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:42:53.404256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac', 'status': 'completed', 'code': 200} Nov 15 12:42:53.490774 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-442ab24a-b2bd-4590-99a6-8aa1572e976e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:53.498325 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-442ab24a-b2bd-4590-99a6-8aa1572e976e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=9c262ff8-39d2-4560-8a17-db7d1bd0eb4f HTTP/1.1" status: 200 len: 849 time: 0.2790425 Nov 15 12:42:53.505822 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.600918 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.602141 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'fixed_ips': [{'subnet_id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:42:53.603244 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.673183 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:53.679186 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-071ffc1e-f37f-455f-8c8b-e09b0f5cc9b1 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=29de8c58-f293-40d7-a944-86383e773ce7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0964417 Nov 15 12:42:53.710158 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Pushing event updated for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:53.825452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-3f138625-8c1a-48c4-beb6-a4c24d9de650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:53.827956 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-3f138625-8c1a-48c4-beb6-a4c24d9de650 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.3225009 Nov 15 12:42:53.847603 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198ebdfc-53c9-4a81-bc98-1f5efb8e1169 req-2447a0f9-499e-4fe5-ae9d-4063e7fed83b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:53.857679 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-198ebdfc-53c9-4a81-bc98-1f5efb8e1169 req-2447a0f9-499e-4fe5-ae9d-4063e7fed83b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 943 time: 0.3650022 Nov 15 12:42:53.890237 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] For port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:53.924420 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77a429d-ccf6-4f58-9e64-8bd6c0ec79b2 req-75186137-4c41-4501-9f8c-19eac5967d0f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:53.940577 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a77a429d-ccf6-4f58-9e64-8bd6c0ec79b2 req-75186137-4c41-4501-9f8c-19eac5967d0f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.3232377 Nov 15 12:42:54.021471 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:54.088088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-198ebdfc-53c9-4a81-bc98-1f5efb8e1169 req-9ad6cef9-e108-448f-9e3b-f689f46419cb tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2282336 Nov 15 12:42:54.164141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:54.164680 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a574c91-adfe-41db-b8b4-ab30fff32bd5 None None] Pushing event updated for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:54.171691 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:54.190712 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-3e29bc83-015d-4f21-b729-154cdef2240e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:54.192345 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-3e29bc83-015d-4f21-b729-154cdef2240e service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.3225610 Nov 15 12:42:54.217962 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:50Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:54.317302 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0afa4722-7dcb-42cf-a796-9d7af1c80466 None None] Provisioning complete for port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:54.318082 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0afa4722-7dcb-42cf-a796-9d7af1c80466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:54.321794 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Allocated IP 172.27.0.71 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:54.337226 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-5449af60-9f7b-4e40-ba73-87365d1a27b9 service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5865922 Nov 15 12:42:54.365903 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a77a429d-ccf6-4f58-9e64-8bd6c0ec79b2 req-70efb609-eedd-415f-993f-9c8b413fd89e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4235330 Nov 15 12:42:54.445529 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-0fcf5c1d-366a-4e07-a472-1afdb46d348b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.0875566 Nov 15 12:42:54.460944 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0afa4722-7dcb-42cf-a796-9d7af1c80466 None None] Port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:54.494924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-114d38d2-2e9e-4c2a-b1b2-4dd7a67e4d62 None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:50Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:42:54.497052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:42:54.544464 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 23721e28-1c53-411d-bdd5-b7abe13ce659 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:54.630540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb19b360-dfdf-47b1-af15-bf0eba8e42e6 req-d691c2e7-2c4e-4cf5-b53d-e43869c23ded tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:54.640050 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bb19b360-dfdf-47b1-af15-bf0eba8e42e6 req-d691c2e7-2c4e-4cf5-b53d-e43869c23ded tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2832851 Nov 15 12:42:54.680997 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-c9bdb552-21d1-43b8-ab70-0e882f07f1d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:54.687899 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-c9bdb552-21d1-43b8-ab70-0e882f07f1d8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.2218528 Nov 15 12:42:54.878747 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-2204b079-0ba3-406a-b49c-34695f16c879 None None] Provisioning complete for port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:54.879504 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2204b079-0ba3-406a-b49c-34695f16c879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:54.883439 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-8dd1ba98-2632-40db-857e-3cff66df1820 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1436799 Nov 15 12:42:54.912066 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-194505c2-4aac-45d2-bef0-63d45de4e7d8 req-4d3e993b-7e9f-4db9-8fd3-673244b2541b service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5419657 Nov 15 12:42:54.944272 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 23721e28-1c53-411d-bdd5-b7abe13ce659 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:54.944906 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:54.947544 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Allocated IP 172.20.0.2 (6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d/33272a70-5cfb-4c4a-a5ae-771ac2aef484/b71dec3c-c92c-47fe-828a-34ca9a4aad09) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:42:55.001774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-2204b079-0ba3-406a-b49c-34695f16c879 None None] Port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:42:55.036762 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.135541 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-1643f39d-6ec8-4f4b-93c8-8656d7fb2d76 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2312167 Nov 15 12:42:55.154214 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bb19b360-dfdf-47b1-af15-bf0eba8e42e6 req-d9c41487-79a6-4d7e-82d4-dfc494b215b1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5131481 Nov 15 12:42:55.240902 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.271566 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 23721e28-1c53-411d-bdd5-b7abe13ce659, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=23721e28-1c53-411d-bdd5-b7abe13ce659,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:55.277146 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.280894 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.362072 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:55.376645 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.376941 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-2937a035-3eee-46b6-8ac9-4fb94634054f admin admin] 10.222.0.44 "PUT /v2.0/routers/0a6e69d4-a625-4ad8-acb4-410cc32f6e75/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0008380 Nov 15 12:42:55.379536 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad943f0d-b57c-498c-95af-20015e749b65 req-868d9105-9665-4302-8057-65dc7a7b91cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:55.382065 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-868d9105-9665-4302-8057-65dc7a7b91cb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5d7b948b852c4d75927625acca00a4d6&device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 1096 time: 0.2419243 Nov 15 12:42:55.410126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:55.425817 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:55.439571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=23721e28-1c53-411d-bdd5-b7abe13ce659,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:55.446208 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da1a8b8a-6f7e-488a-ad5e-5570097b3001 req-c8bdbc83-2c27-465a-929d-c79339271f24 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2791705 Nov 15 12:42:55.470127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:55.522331 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:55.524554 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:42:55.529702 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:42:55.535309 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:42:55.678934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a56f83c-1bff-43a7-82ca-7ae23eb2e803 req-0e11267c-a8a9-48e7-9c11-4d9c24c3e4f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:55.681686 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7a56f83c-1bff-43a7-82ca-7ae23eb2e803 req-0e11267c-a8a9-48e7-9c11-4d9c24c3e4f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1800978 Nov 15 12:42:55.721483 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Pushing event updated for resources: {'Port': ['ID=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:55.793761 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db15ec71-0d14-4861-b342-0bbeec5119b4 req-f5b2e133-6606-453d-89a5-b9d23c837b7f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:55.812560 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-db15ec71-0d14-4861-b342-0bbeec5119b4 req-f5b2e133-6606-453d-89a5-b9d23c837b7f tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 943 time: 0.4623020 Nov 15 12:42:55.858265 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:42:55.884241 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Attempting to bind port b71dec3c-c92c-47fe-828a-34ca9a4aad09 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:42:55.884744 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Attempting to bind port b71dec3c-c92c-47fe-828a-34ca9a4aad09 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:42:55.885353 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Attempting to bind port b71dec3c-c92c-47fe-828a-34ca9a4aad09 on network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:42:55.922785 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7a56f83c-1bff-43a7-82ca-7ae23eb2e803 req-32da5ae8-8eff-4531-939f-19105791e8e7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2239308 Nov 15 12:42:56.027090 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad943f0d-b57c-498c-95af-20015e749b65 req-07aaa41a-cef5-4b72-82fd-ef2e1b001e48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:56.029179 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-07aaa41a-cef5-4b72-82fd-ef2e1b001e48 service neutron] 10.222.0.61 "GET /v2.0/networks?id=29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 200 len: 910 time: 0.6013539 Nov 15 12:42:56.061858 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-db15ec71-0d14-4861-b342-0bbeec5119b4 req-ad08242a-4d9c-48af-a342-7e86d52c2250 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2465541 Nov 15 12:42:56.105034 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Pushing event updated for resources: {'Port': ['ID=b71dec3c-c92c-47fe-828a-34ca9a4aad09,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:56.120871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:42:56.121517 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Checking segment: {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:42:56.122196 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.122972 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Bound using segment: {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:42:56.123734 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Bound port: b71dec3c-c92c-47fe-828a-34ca9a4aad09, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:42:56.124377 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.154193 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-10195dc3-6dca-4fb2-8a15-d6a05e092c62 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e7e580cd-1661-4485-bb46-67ecab8410ac HTTP/1.1" status: 200 len: 217 time: 0.1060684 Nov 15 12:42:56.285408 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 987bb19a-6a1a-4482-b727-c4a8e9b2f55c up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:56.291847 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:56.358835 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:42:56.393072 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] For port b71dec3c-c92c-47fe-828a-34ca9a4aad09, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:42:56.398263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] For port b71dec3c-c92c-47fe-828a-34ca9a4aad09, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=b71dec3c-c92c-47fe-828a-34ca9a4aad09,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:42:56.415495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.585003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe632b61-a421-4bcc-8e0a-7cc392d5363b req-2b601e28-684f-4290-a0da-15fa0e08555e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:56.591691 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.596343 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5fa9dc-cf2b-4523-aede-9c1406849e3d None None] Pushing event updated for resources: {'Port': ['ID=b71dec3c-c92c-47fe-828a-34ca9a4aad09,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:56.599996 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fe632b61-a421-4bcc-8e0a-7cc392d5363b req-2b601e28-684f-4290-a0da-15fa0e08555e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2245491 Nov 15 12:42:56.623868 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:56.624685 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.675775 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:42:56.723814 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:56.752582 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:56.797113 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fe632b61-a421-4bcc-8e0a-7cc392d5363b req-576218e3-1fbf-47c1-b879-84fc60e9d06c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1957788 Nov 15 12:42:56.935233 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=6']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:42:57.113841 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad943f0d-b57c-498c-95af-20015e749b65 req-fa062274-a8d4-4b68-a2cc-12f9f1ec734c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:57.121369 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-fa062274-a8d4-4b68-a2cc-12f9f1ec734c service neutron] 10.222.0.61 "GET /v2.0/subnets?id=9c262ff8-39d2-4560-8a17-db7d1bd0eb4f HTTP/1.1" status: 200 len: 849 time: 0.9527464 Nov 15 12:42:57.151802 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 23721e28-1c53-411d-bdd5-b7abe13ce659 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:57.229953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fd726f3-0fe1-416c-89c3-d641b19498bb req-e40472a8-5c2d-46c4-a0a7-52ec4063f0b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:57.256334 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7fd726f3-0fe1-416c-89c3-d641b19498bb req-e40472a8-5c2d-46c4-a0a7-52ec4063f0b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1459301 Nov 15 12:42:57.307973 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 23721e28-1c53-411d-bdd5-b7abe13ce659 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:57.308722 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:57.352328 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-d15b6e8d-c7ed-4782-8ee2-f9cd031856b2 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=29de8c58-f293-40d7-a944-86383e773ce7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1843958 Nov 15 12:42:57.418819 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Sync routers for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:57.435278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7fd726f3-0fe1-416c-89c3-d641b19498bb req-619eac64-b91f-4881-a365-7009ae8f33d9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1775422 Nov 15 12:42:57.502185 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['36928b8a-e800-43e0-9edd-e13ae44ee93e'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:42:57.544888 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3cab12-1365-40f0-a3ec-b92af933d8b9 req-8ec9950a-d100-4fc8-b04c-33843426003b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:57.553727 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4b3cab12-1365-40f0-a3ec-b92af933d8b9 req-8ec9950a-d100-4fc8-b04c-33843426003b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.4434745 Nov 15 12:42:57.565372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:57.683763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:57.684449 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:57.873978 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0be303-13b5-4dc5-af6d-40eb58135bdc req-b8b649fb-ebe7-4871-b83a-3bd3ce7ff222 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:57.876713 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8c0be303-13b5-4dc5-af6d-40eb58135bdc req-b8b649fb-ebe7-4871-b83a-3bd3ce7ff222 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 943 time: 0.2232802 Nov 15 12:42:58.004844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e7e580cd-1661-4485-bb46-67ecab8410ac details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:42:58.027889 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8c0be303-13b5-4dc5-af6d-40eb58135bdc req-36308834-0898-4cfb-8758-0b660051991e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1446819 Nov 15 12:42:58.117924 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4b3cab12-1365-40f0-a3ec-b92af933d8b9 req-73a3db10-2537-4f6d-8753-18b7a722d763 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5618196 Nov 15 12:42:58.124889 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-67918377-b7e8-45a3-a4c1-c69e1285ed1c service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7477026 Nov 15 12:42:58.241019 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:58.266322 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device b71dec3c-c92c-47fe-828a-34ca9a4aad09 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:42:58.309109 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.db.resource_extend [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 15 12:42:58.382913 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2afefa70-bf1b-4eaa-b1aa-6a017f9d5b3b req-4cfb4f05-87a5-46e9-b1cb-5417dc894e2e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:58.395508 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2afefa70-bf1b-4eaa-b1aa-6a017f9d5b3b req-4cfb4f05-87a5-46e9-b1cb-5417dc894e2e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.1101670 Nov 15 12:42:58.510427 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2afefa70-bf1b-4eaa-b1aa-6a017f9d5b3b req-750f6a48-830a-4113-91fc-f69b9b8971a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1139023 Nov 15 12:42:58.664342 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a18b9b00-0e70-4260-b98d-aacae88aceac None None] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:42:58.713228 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port b71dec3c-c92c-47fe-828a-34ca9a4aad09 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:58.713975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:58.763110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf3fe5e-2515-4b46-9023-7620db141187 req-77e658a3-38d4-47e7-a111-bab93925f611 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:58.766193 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4cf3fe5e-2515-4b46-9023-7620db141187 req-77e658a3-38d4-47e7-a111-bab93925f611 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1815286 Nov 15 12:42:58.863310 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108286) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:42:58.883977 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad943f0d-b57c-498c-95af-20015e749b65 req-d03f9e2c-3436-4c56-8757-a9a1d87ea393 service neutron] 10.222.0.61 "GET /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6279671 Nov 15 12:42:58.928704 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:59.154017 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4cf3fe5e-2515-4b46-9023-7620db141187 req-86e4db3e-a380-424c-b8d6-9088f677f693 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3593614 Nov 15 12:42:59.237749 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e7e580cd-1661-4485-bb46-67ecab8410ac,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:42:59.264223 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:42:59.281340 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Sync routers for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:42:59.287587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'e7e580cd-1661-4485-bb46-67ecab8410ac', 'network_id': '29de8c58-f293-40d7-a944-86383e773ce7', 'port_id': 'e7e580cd-1661-4485-bb46-67ecab8410ac', 'mac_address': 'fa:16:3e:36:64:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 646, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9c262ff8-39d2-4560-8a17-db7d1bd0eb4f', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:42:59.297382 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:42:59.299061 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:59.314840 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:59.319843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 52254) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:42:59.324781 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-362844ae-65cf-45a8-a170-8cccb536df11 admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 7.8660517 Nov 15 12:42:59.453736 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:42:59.563352 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b6293b-a68f-4d69-ad8f-7e9f5db5994e req-7b25bc95-646e-4eb1-8573-9209a2ee467d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:59.576167 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e07a8bf9-bcd2-41a8-855f-7482202dbc17 None None] Provisioning complete for port b71dec3c-c92c-47fe-828a-34ca9a4aad09 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:42:59.577019 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e07a8bf9-bcd2-41a8-855f-7482202dbc17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:42:59.577379 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91b6293b-a68f-4d69-ad8f-7e9f5db5994e req-7b25bc95-646e-4eb1-8573-9209a2ee467d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 943 time: 0.2935984 Nov 15 12:42:59.627760 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12204e2-7f7d-49e0-8ac4-4418792848f4 req-6aa8ddc4-1d1f-4607-bdcc-09488ba656b6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:42:59.637754 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a12204e2-7f7d-49e0-8ac4-4418792848f4 req-6aa8ddc4-1d1f-4607-bdcc-09488ba656b6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.2293212 Nov 15 12:42:59.729512 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91b6293b-a68f-4d69-ad8f-7e9f5db5994e req-a8747fab-c992-456d-81e7-34d0424221d7 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1506815 Nov 15 12:42:59.800031 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:42:56Z', 'revision_number': 3, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:42:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:42:59.833355 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a12204e2-7f7d-49e0-8ac4-4418792848f4 req-ce626022-f880-47c9-9526-335af59afd6b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1874764 Nov 15 12:42:59.867105 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Checking router: d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:42:59.869286 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Updating router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:42:59.936640 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.038804 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.190339 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e7e580cd-1661-4485-bb46-67ecab8410ac {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:43:00.217107 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-925c1edc-bb3e-48c4-8a48-a3c7e3187742 req-8a1b2f39-78e9-4c8f-9fb8-7b8fb0dd3619 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:00.234688 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-925c1edc-bb3e-48c4-8a48-a3c7e3187742 req-8a1b2f39-78e9-4c8f-9fb8-7b8fb0dd3619 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.2434647 Nov 15 12:43:00.278397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.306959 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e7e580cd-1661-4485-bb46-67ecab8410ac,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:00.318886 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.393837 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e07a8bf9-bcd2-41a8-855f-7482202dbc17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.418179 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-925c1edc-bb3e-48c4-8a48-a3c7e3187742 req-b6f8afe7-d429-4d2a-91d7-eb706c34e0a1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1741021 Nov 15 12:43:00.508622 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:00.604254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08048ee2-cc1f-4c47-8a31-e6b26595a2eb req-9003a0e9-b88d-4754-a036-6e12f18c671f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:00.621231 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-08048ee2-cc1f-4c47-8a31-e6b26595a2eb req-9003a0e9-b88d-4754-a036-6e12f18c671f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.2067227 Nov 15 12:43:00.699678 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port b71dec3c-c92c-47fe-828a-34ca9a4aad09, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=b71dec3c-c92c-47fe-828a-34ca9a4aad09,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:00.738990 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.754252 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.760591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:00.771767 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:52Z', 'revision_number': 4, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'eaaa6061-3a7a-41d0-ac7b-b1f20ee16305', 'name': '', 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'mac_address': 'fa:16:3e:6e:ee:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:50Z', 'updated_at': '2021-11-15T12:42:52Z', 'revision_number': 2, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'subnets': [{'id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:00.777996 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.807093 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-08048ee2-cc1f-4c47-8a31-e6b26595a2eb req-09fdb3c8-1f71-4441-85c8-1167b2ba68f4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1836479 Nov 15 12:43:00.917540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:00.965257 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.965862 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.966476 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.967086 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.967685 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.968294 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.968890 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.969483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.970096 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.970750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.973226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.973226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:00.978755 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Checking router: 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:43:00.979351 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Updating router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:43:01.027509 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Attempting to bind port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:43:01.027509 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Attempting to bind port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:43:01.027509 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Attempting to bind port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:01.046730 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1088c5ac-1aa8-49f2-851d-ff5b90679468 None None] Pushing event updated for resources: {'Port': ['ID=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:01.083112 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:43:01.087056 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:43:01.090355 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.091004 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:43:01.094614 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Bound port: 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:43:01.098149 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.137576 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.db.api [None req-e07a8bf9-bcd2-41a8-855f-7482202dbc17 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108288) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 15 12:43:01.138184 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG oslo_db.api [None req-e07a8bf9-bcd2-41a8-855f-7482202dbc17 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 15 12:43:01.143757 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.183705 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Allocated IP 172.20.0.1 (6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d/33272a70-5cfb-4c4a-a5ae-771ac2aef484/9e3e5a57-202b-4956-9bfa-1efe13e22ab3) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:43:01.266558 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 36928b8a-e800-43e0-9edd-e13ae44ee93e triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:01.268064 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.285951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5635954c-bbc6-4964-b596-292f74b0f846 req-62d03278-d6c4-45a9-9cf5-edd4efe96f59 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:01.288736 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5635954c-bbc6-4964-b596-292f74b0f846 req-62d03278-d6c4-45a9-9cf5-edd4efe96f59 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.1145182 Nov 15 12:43:01.316371 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383304a-25e6-4dcb-8c1a-13b71164079b req-5a1954ae-5f18-4e3b-856b-1d117d530e37 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:01.318864 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5383304a-25e6-4dcb-8c1a-13b71164079b req-5a1954ae-5f18-4e3b-856b-1d117d530e37 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.2439787 Nov 15 12:43:01.426593 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['e7e580cd-1661-4485-bb46-67ecab8410ac'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:43:01.453394 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=b71dec3c-c92c-47fe-828a-34ca9a4aad09,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:01.511416 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5383304a-25e6-4dcb-8c1a-13b71164079b req-bbbcfa90-0037-4fce-8f3d-6d4accd3348d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1661074 Nov 15 12:43:01.569564 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Deleting port 040c1614-f002-4947-93a6-47ec1e469e42 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:43:01.572485 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.573867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0496e009-a116-49f9-9dca-e7ffdcc7c1a2 req-b148da8a-c688-4f50-ae0f-6557c790079e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:01.585344 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0496e009-a116-49f9-9dca-e7ffdcc7c1a2 req-b148da8a-c688-4f50-ae0f-6557c790079e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.6655450 Nov 15 12:43:01.622398 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.639912 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] For port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:43:01.643452 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] For port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:43:01.649409 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.754088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0496e009-a116-49f9-9dca-e7ffdcc7c1a2 req-268197f9-452d-4824-a401-8d826a6c85cb tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1677487 Nov 15 12:43:01.805069 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:43:01.807516 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:42:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:01.819367 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:01.912011 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2946558-5b3b-465a-908f-5d61f3072b8f req-7507f249-e38d-45a4-8dae-cadb35e23908 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:01.928771 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2946558-5b3b-465a-908f-5d61f3072b8f req-7507f249-e38d-45a4-8dae-cadb35e23908 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.2224689 Nov 15 12:43:02.149321 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1088c5ac-1aa8-49f2-851d-ff5b90679468 None None] Pushing event updated for resources: {'Port': ['ID=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:02.238127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] For port 040c1614-f002-4947-93a6-47ec1e469e42, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=040c1614-f002-4947-93a6-47ec1e469e42,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:02.252944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:02.284661 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:43:02.310446 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:43:02.329011 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Pushing event updated for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:02.355372 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:43:02.356226 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2946558-5b3b-465a-908f-5d61f3072b8f req-c8898080-6303-4914-a0d3-fce7e009fa3a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4262986 Nov 15 12:43:02.357770 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Calling delete_port for 040c1614-f002-4947-93a6-47ec1e469e42 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:43:02.519339 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:43:02.672717 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-bed35211-8c28-4312-8947-1312125ffe02 None None] Provisioning complete for port b71dec3c-c92c-47fe-828a-34ca9a4aad09 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:02.674167 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bed35211-8c28-4312-8947-1312125ffe02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:02.716534 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3239ea2-b64e-47bd-8fe4-b8cb70bcc326 req-640dd082-e817-4eac-bb4b-e959e5e3e8b6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:02.730363 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b3239ea2-b64e-47bd-8fe4-b8cb70bcc326 req-640dd082-e817-4eac-bb4b-e959e5e3e8b6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.5955291 Nov 15 12:43:02.754698 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:02.809572 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:03.033459 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device b71dec3c-c92c-47fe-828a-34ca9a4aad09 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:03.044814 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:03.120627 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c76674-90b2-4bf6-9ecd-e4f4e90ca7e5 req-dbf6d7f2-e922-4f87-bea2-9d6c9c04be2b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:03.147209 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-06c76674-90b2-4bf6-9ecd-e4f4e90ca7e5 req-dbf6d7f2-e922-4f87-bea2-9d6c9c04be2b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 945 time: 0.4225664 Nov 15 12:43:03.167344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event deleted for resources: {'Port': ['ID=040c1614-f002-4947-93a6-47ec1e469e42,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:03.419507 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] No DVR routers for this DVR port 040c1614-f002-4947-93a6-47ec1e469e42 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:43:03.424424 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:03.429541 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5635954c-bbc6-4964-b596-292f74b0f846 req-c91fe3b8-efb5-4db1-959a-59b3ab9de0cd tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "DELETE /v2.0/ports/040c1614-f002-4947-93a6-47ec1e469e42 HTTP/1.1" status: 204 len: 173 time: 2.1094282 Nov 15 12:43:03.431852 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:42:56Z', 'revision_number': 3, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:03.441608 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'name': 'network-vif-deleted', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:03.453336 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a224f340-b08a-4c3d-b37a-95d62ac5c62a" -d '{"events": [{"server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "name": "network-vif-deleted", "tag": "040c1614-f002-4947-93a6-47ec1e469e42"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:03.529030 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c99777a0-db97-439e-99e7-d37f174a6959 None None] The sync data for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi is: [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:42:56Z', 'revision_number': 3, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:43:03.566831 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-06c76674-90b2-4bf6-9ecd-e4f4e90ca7e5 req-eeef177e-7339-4e80-85ab-d151aeb1cb72 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4169471 Nov 15 12:43:03.932629 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079644ea-f099-4c4c-97f3-2f294fe4707c req-74726fc9-f818-471e-b149-f78e045e0b59 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:03.945889 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-079644ea-f099-4c4c-97f3-2f294fe4707c req-74726fc9-f818-471e-b149-f78e045e0b59 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.1769328 Nov 15 12:43:04.045999 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b3239ea2-b64e-47bd-8fe4-b8cb70bcc326 req-0149e1d5-1b36-4214-85c6-479df1ad9d0e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3144023 Nov 15 12:43:04.065215 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.174654 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-079644ea-f099-4c4c-97f3-2f294fe4707c req-3b8b58c8-23e1-4637-b141-8d58e5ed3d09 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2253764 Nov 15 12:43:04.349392 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a682c6b-adbf-4ac3-8e7d-982ab14d3759 x-openstack-request-id: req-1a682c6b-adbf-4ac3-8e7d-982ab14d3759 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:04.350179 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9d76fb4-59d7-4c48-a611-530810a191d8", "name": "network-vif-deleted", "tag": "040c1614-f002-4947-93a6-47ec1e469e42", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:04.350779 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-1a682c6b-adbf-4ac3-8e7d-982ab14d3759 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:04.351376 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9d76fb4-59d7-4c48-a611-530810a191d8', 'name': 'network-vif-deleted', 'tag': '040c1614-f002-4947-93a6-47ec1e469e42', 'status': 'completed', 'code': 200} Nov 15 12:43:04.355352 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.360329 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:04.365619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ef7afcd-bac4-4149-8115-a500713146e4" -d '{"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:04.454817 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.471762 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:04.590126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08f0caca-7891-4477-a72b-0ee45277df65 x-openstack-request-id: req-08f0caca-7891-4477-a72b-0ee45277df65 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:04.590941 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:04.591800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-08f0caca-7891-4477-a72b-0ee45277df65 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:04.592666 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'code': 200} Nov 15 12:43:04.602452 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.659208 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1112af85-6287-44dd-8828-61ababcfd2a1 req-70e81277-7267-45db-b8a3-49eb3316013e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:04.661346 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1112af85-6287-44dd-8828-61ababcfd2a1 req-70e81277-7267-45db-b8a3-49eb3316013e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.3183162 Nov 15 12:43:04.758597 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4b939354-0430-48c5-a2a4-6aa736d9f234 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.891032 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.901144 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-789f7f7b-0655-47e6-b979-e55e328503e9 req-e8dde4f1-985e-4735-8ab3-9cde399a23d4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0931079 Nov 15 12:43:04.904940 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:04.926908 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port b71dec3c-c92c-47fe-828a-34ca9a4aad09 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:04.927286 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:05.030953 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b6b678-1059-4b74-ba5b-388ac9077fb0 None None] Pushing event updated for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:05.181088 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:05.248991 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=7']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:05.430024 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1112af85-6287-44dd-8828-61ababcfd2a1 req-bff611ec-d21b-40ec-84ee-29612a5e10b1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7275732 Nov 15 12:43:05.461610 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Pushing event updated for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:05.597723 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b4d389-ff77-448b-a894-f9725205e844 req-0ae0aa1d-63d6-4369-b3c8-aaf4476f2a46 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:05.599360 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82b4d389-ff77-448b-a894-f9725205e844 req-0ae0aa1d-63d6-4369-b3c8-aaf4476f2a46 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1915605 Nov 15 12:43:05.618019 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Attempting to bind port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:43:05.625975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Attempting to bind port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:43:05.627455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Attempting to bind port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 on network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:05.695104 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 42, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:43:05.695534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Checking segment: {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:43:05.695881 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:05.696300 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Bound using segment: {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:43:05.696787 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Bound port: eaaa6061-3a7a-41d0-ac7b-b1f20ee16305, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '162eb35d-70e4-43af-a8e2-2e32e5bf12e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:43:05.707402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:05.708642 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:43:05.715265 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:43:05.725028 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82b4d389-ff77-448b-a894-f9725205e844 req-a7825c74-ac1f-476a-a0d2-0e458441347c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1107192 Nov 15 12:43:05.779420 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Provisioning complete for port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:05.779420 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.072901 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:06.169062 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:43:06.170134 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3233e111-b502-4795-a4e4-5f941c4fc449 req-b699a5ed-60db-48d9-b9eb-ef207e0ca15a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0520847 Nov 15 12:43:06.203414 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93db9e1f-4542-4a40-8342-cdcbd64c1fda req-0462a64c-e51b-4d16-adf4-4c90d282122b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:06.214835 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-93db9e1f-4542-4a40-8342-cdcbd64c1fda req-0462a64c-e51b-4d16-adf4-4c90d282122b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.5938268 Nov 15 12:43:06.242255 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e3291675-cf57-45f8-b035-2542b2dd7de5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.273477 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:43:06.286091 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:06.286591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.361537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] For port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:43:06.396400 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Provisioning complete for port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:06.396783 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.420864 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-93db9e1f-4542-4a40-8342-cdcbd64c1fda req-55909954-d554-4438-b26f-c45044288634 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2048140 Nov 15 12:43:06.472113 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] For port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:43:06.495817 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:43:06.507915 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1953e99f-dfeb-455b-8e2c-45adbd4a8fc0 admin admin] 10.222.0.44 "PUT /v2.0/routers/d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1861749 Nov 15 12:43:06.532430 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.611800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.617546 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-7bb55dd3-29ca-4100-8e24-5c1c567204ac None None] Port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:43:06.709406 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:06.719919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:06.750521 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:43:06.751165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:43:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:06.874615 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1a433d-609f-4feb-9d34-6b4e3bcab5d9 req-8ee2c6b3-0208-4c84-af1a-e57d0be62cf8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:06.892669 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e1a433d-609f-4feb-9d34-6b4e3bcab5d9 req-8ee2c6b3-0208-4c84-af1a-e57d0be62cf8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1608706 Nov 15 12:43:06.905593 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b6b678-1059-4b74-ba5b-388ac9077fb0 None None] Pushing event updated for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:06.990758 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1068dd0e-2995-4b3c-acd7-b23a4baa2181 req-4c0a0351-85af-43d1-ac5e-63e32256c7ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:07.022821 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1068dd0e-2995-4b3c-acd7-b23a4baa2181 req-4c0a0351-85af-43d1-ac5e-63e32256c7ad tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1466446 Nov 15 12:43:07.150958 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e1a433d-609f-4feb-9d34-6b4e3bcab5d9 req-50a20b76-4226-49d3-ba18-2dbc0c183415 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2571929 Nov 15 12:43:07.237668 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1068dd0e-2995-4b3c-acd7-b23a4baa2181 req-c752ca80-b15a-4676-b4dc-37bd6dd5ed4a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2138867 Nov 15 12:43:07.243927 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e521778a-1eb7-4e12-9957-363160a61ce3 None None] Provisioning complete for port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:07.253955 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e521778a-1eb7-4e12-9957-363160a61ce3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:07.354547 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:07.380458 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Sync routers for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:43:07.429470 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:43:07.474009 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-adaa041c-b103-49cd-888f-40b57ae986c6 req-b69b8983-b739-4567-8a92-1e6031aed038 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.0867314 Nov 15 12:43:07.598282 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:07.626161 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-e521778a-1eb7-4e12-9957-363160a61ce3 None None] Port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:43:07.630534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:43:07.633333 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:43:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:07.786999 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0a6cd6-7d5e-4ab5-9662-a3df3345aa43 req-132263ef-3775-42f3-9b46-534e25271d2a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:07.822568 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e0a6cd6-7d5e-4ab5-9662-a3df3345aa43 req-132263ef-3775-42f3-9b46-534e25271d2a tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.1862626 Nov 15 12:43:07.980716 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:07.982186 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e0a6cd6-7d5e-4ab5-9662-a3df3345aa43 req-cfe18489-b3ef-4b7a-9b80-f6373f617958 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1577275 Nov 15 12:43:08.198484 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 040c1614-f002-4947-93a6-47ec1e469e42 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:08.230349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 52356) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:08.241478 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-690150005', 'description': 'tempest-secgroup-smoke-690150005 description', 'project_id': 'ad165f3ffe59498e88611526ef4c254d'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:08.250124 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 040c1614-f002-4947-93a6-47ec1e469e42 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:43:08.250819 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 040c1614-f002-4947-93a6-47ec1e469e42 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:43:08.254184 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] Provisioning complete for port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:08.254899 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:08.261124 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:43:08.352781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:08.576100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e220e24d-a1ad-4d75-8b49-dfdf62be9ed0 req-e93ecab2-0f82-4ceb-bcd8-1f7b48f859cf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:08.585390 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e220e24d-a1ad-4d75-8b49-dfdf62be9ed0 req-e93ecab2-0f82-4ceb-bcd8-1f7b48f859cf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1597230 Nov 15 12:43:08.661807 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:08.674330 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:08.693969 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e220e24d-a1ad-4d75-8b49-dfdf62be9ed0 req-c4454bb5-6b0f-43b4-8d1b-fb5bddde2aa8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996990 Nov 15 12:43:08.716112 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:08.717842 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.4841826 Nov 15 12:43:08.723529 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52362) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:08.732033 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:08.763521 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e213e1c1-809b-4e4e-8e16-1b2a83067d2b req-abaac151-1932-4062-a193-b4cd0223ecc9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:08.773463 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e213e1c1-809b-4e4e-8e16-1b2a83067d2b req-abaac151-1932-4062-a193-b4cd0223ecc9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2956057 Nov 15 12:43:08.888088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e213e1c1-809b-4e4e-8e16-1b2a83067d2b req-999e3c7c-470d-453f-bfb5-0bf1a336e905 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1029546 Nov 15 12:43:08.891419 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c85a8630-167a-4bf4-96d1-e738ef8543e1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f5f8a6e7-eff7-4cff-a4f3-64559906341e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:08.979570 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.303393 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.378544 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0adb89a8-1810-4829-a9a4-3eab27af4439 req-656dc938-58f3-4e44-95f1-36455170f182 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d9d76fb4-59d7-4c48-a611-530810a191d8 HTTP/1.1" status: 200 len: 210 time: 0.2031751 Nov 15 12:43:09.399159 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.417738 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.423730 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.437036 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c429d10-d6d6-497b-827f-b7297779edde req-142cba1f-5013-4202-b36c-506e2cd4775b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:09.480976 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9926cbd-4545-4aab-98c4-08ac0c46fc65,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:09.485690 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c429d10-d6d6-497b-827f-b7297779edde req-142cba1f-5013-4202-b36c-506e2cd4775b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.3365889 Nov 15 12:43:09.515616 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.522402 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1dd02b5f-51ec-44b7-8f02-78bf8fb909a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7960095 Nov 15 12:43:09.526144 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52370) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:09.546508 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:09.562508 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670', '9e843abc-71ca-433a-a92b-f035c2503fb4', 'a106f2a9-c144-4b28-9287-b71a667e6786'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:43:09.718329 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c429d10-d6d6-497b-827f-b7297779edde req-3a53547b-139d-4fb7-8ce5-a1d19639c88e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2309694 Nov 15 12:43:09.868900 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:09.902845 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:09.903612 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.103136 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e7e580cd-1661-4485-bb46-67ecab8410ac up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:10.149794 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.154618 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.168563 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.214591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:43:03Z', 'revision_number': 4, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '9e3e5a57-202b-4956-9bfa-1efe13e22ab3', 'name': '', 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'mac_address': 'fa:16:3e:e2:4c:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 439, 'fixed_ips': [{'subnet_id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:43:00Z', 'updated_at': '2021-11-15T12:43:04Z', 'revision_number': 2, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'subnets': [{'id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:10.233842 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46debbf1-dca7-40bb-b8be-95c49ce7439d req-54bbffbe-e0b4-4111-b9cf-91412d733d81 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:10.242975 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-46debbf1-dca7-40bb-b8be-95c49ce7439d req-54bbffbe-e0b4-4111-b9cf-91412d733d81 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1249044 Nov 15 12:43:10.291737 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=927b382b-4a8c-4664-9ac7-22a5dd4918de,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:10.311347 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.317866 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e4f2c204-1e16-4931-9e64-58d45a64c5a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7858274 Nov 15 12:43:10.318804 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] For port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:10.325397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Checking router: d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:43:10.325889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Updating router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:43:10.331045 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52382) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:10.338147 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.359502 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:10.371766 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-46debbf1-dca7-40bb-b8be-95c49ce7439d req-d198dc83-fef0-4906-9add-f5a78dc91fd9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1190991 Nov 15 12:43:10.386912 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a608994-10f8-4475-9abd-8579a7719fba req-750a26ca-70e6-4ea4-9029-8b96229edae3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:10.396815 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9a608994-10f8-4475-9abd-8579a7719fba req-750a26ca-70e6-4ea4-9029-8b96229edae3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.3284354 Nov 15 12:43:10.428890 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:52Z', 'revision_number': 4, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'eaaa6061-3a7a-41d0-ac7b-b1f20ee16305', 'name': '', 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'mac_address': 'fa:16:3e:6e:ee:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:50Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'subnets': [{'id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:10.477963 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8f3bca7-7110-460d-8d26-65e177ee447e None None] The sync data for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi is: [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:42:52Z', 'revision_number': 4, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'eaaa6061-3a7a-41d0-ac7b-b1f20ee16305', 'name': '', 'network_id': 'd4aeb5a7-8b26-4fee-94f1-32dc4233e0f6', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'mac_address': 'fa:16:3e:6e:ee:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_interface', 'standard_attr_id': 435, 'fixed_ips': [{'subnet_id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:50Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'subnets': [{'id': '6efd7478-ea59-4576-b80a-5a4beb76d983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:43:10.484230 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port e7e580cd-1661-4485-bb46-67ecab8410ac completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:43:10.508037 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.551469 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port e7e580cd-1661-4485-bb46-67ecab8410ac triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:10.552708 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.642009 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9a608994-10f8-4475-9abd-8579a7719fba req-2e92a65b-9868-4cd8-b292-d6f7c2459560 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2442687 Nov 15 12:43:10.656511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.719322 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5689a68-5063-4587-bc70-f8c671d2ac42 None None] Pushing event updated for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:10.841511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.847674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.905774 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68192ae8-5a4e-4447-931c-86532ebd17a4,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:10.916510 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:10.920070 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-256dc3b7-4979-47a5-b0eb-b114529fdea5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5727053 Nov 15 12:43:10.923552 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 52392) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:10.928484 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:11.153726 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.250097 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-106341e8-63f4-4fba-a695-8e36075c9ec1 req-216f99cd-bd14-49c3-974a-665ed1396648 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:11.261945 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-106341e8-63f4-4fba-a695-8e36075c9ec1 req-216f99cd-bd14-49c3-974a-665ed1396648 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 944 time: 0.2594166 Nov 15 12:43:11.396538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.444441 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-106341e8-63f4-4fba-a695-8e36075c9ec1 req-274d4f7c-0150-4e70-b9df-bcd31d250deb tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1813655 Nov 15 12:43:11.450235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.514486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.518749 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5911307 Nov 15 12:43:11.519245 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52398) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:11.524476 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:11.525733 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bedc2bc2-d4fb-4625-bcf0-4430a03a2505 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1a543d6d-83af-4202-b599-61bb94fb2a84,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:11.612493 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.securitygroups_db [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Project ad165f3ffe59498e88611526ef4c254d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:43:11.622518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.689160 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78a19a7-2caa-4b2b-ae38-ed245463a3e1 req-35b19cd4-9854-4a48-8742-4fc3c452cec8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:11.703132 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c78a19a7-2caa-4b2b-ae38-ed245463a3e1 req-35b19cd4-9854-4a48-8742-4fc3c452cec8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1369762 Nov 15 12:43:11.727471 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.888072 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.927369 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c78a19a7-2caa-4b2b-ae38-ed245463a3e1 req-7bf237b3-b692-46fd-bf0f-acf1046c031f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2232804 Nov 15 12:43:11.933586 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:11.940238 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330313d1-4644-481a-af59-678038df8f48 req-1000529b-6f5d-485c-806f-3f47802b71ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:11.950961 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-330313d1-4644-481a-af59-678038df8f48 req-1000529b-6f5d-485c-806f-3f47802b71ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1813362 Nov 15 12:43:11.990548 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e7e580cd-1661-4485-bb46-67ecab8410ac,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:11.997912 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:12.002009 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8658c89d-f038-4cba-ba6e-c799398e541f,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:12.003966 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3ca6a44-f3ab-4782-bbbf-a9fa1e28b624" -d '{"events": [{"server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "name": "network-vif-plugged", "status": "completed", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:12.042407 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.053302 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.057637 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1eb55513-9036-49de-8638-eba8826feb0a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5371239 Nov 15 12:43:12.059020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 52406) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:12.073441 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'security_group_rule': {'security_group_id': 'f5f8a6e7-eff7-4cff-a4f3-64559906341e', 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:12.162937 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:12.164047 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-330313d1-4644-481a-af59-678038df8f48 req-3ce6a8f2-e54b-4452-9013-80139ce84c4f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2015684 Nov 15 12:43:12.185350 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ecb818e-baaa-49d9-aef7-f779e1f08dec x-openstack-request-id: req-0ecb818e-baaa-49d9-aef7-f779e1f08dec {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:12.185866 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "name": "network-vif-plugged", "status": "completed", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:12.185986 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-0ecb818e-baaa-49d9-aef7-f779e1f08dec {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:12.187918 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.securitygroups_db [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Project ad165f3ffe59498e88611526ef4c254d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:43:12.189006 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac', 'code': 200} Nov 15 12:43:12.205401 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.403225 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.418233 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.457806 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=908a1e94-47e5-456a-a343-6dafc2ac444d,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:12.476985 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.479931 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.484341 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-b41f24ce-68b9-4891-9226-bc708c3fae7e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4202867 Nov 15 12:43:12.502614 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:12.606572 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45f3603-ee22-454b-8167-2babdad54184 None None] Pushing event updated for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:12.725675 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:12.829732 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4508ef7e-7d36-44e0-97c6-710c3da47480 req-91350664-e58c-4e54-a96a-3aa6aece713e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:12.837997 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4508ef7e-7d36-44e0-97c6-710c3da47480 req-91350664-e58c-4e54-a96a-3aa6aece713e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1186037 Nov 15 12:43:13.017312 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4508ef7e-7d36-44e0-97c6-710c3da47480 req-1989b4a2-1d04-4ac6-ace0-c9c66e659fd6 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150448 Nov 15 12:43:13.019316 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Attempting to bind port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:43:13.019316 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Attempting to bind port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:43:13.019316 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Attempting to bind port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 on network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:13.049887 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 43, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:43:13.050742 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Checking segment: {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:43:13.052004 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:13.052948 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Bound using segment: {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:43:13.054870 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Bound port: 9e3e5a57-202b-4956-9bfa-1efe13e22ab3, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b9d446ec-d69d-4086-b2dc-ff17004bdb41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:43:13.056623 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:13.269454 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] For port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:43:13.273151 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] For port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:43:13.290761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e142959-45af-4e9c-bbe3-b1c86b31007e req-b17d11c7-ec4a-4889-a6de-76677ec554d2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:13.300422 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e142959-45af-4e9c-bbe3-b1c86b31007e req-b17d11c7-ec4a-4889-a6de-76677ec554d2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1459787 Nov 15 12:43:13.311008 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:13.316955 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:13.317611 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:13.402882 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba44b68-6b7a-4cc9-980c-105f4b038832 req-ae774e68-492e-47fe-ba4c-9e087f490491 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:13.406441 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0ba44b68-6b7a-4cc9-980c-105f4b038832 req-ae774e68-492e-47fe-ba4c-9e087f490491 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1017208 Nov 15 12:43:13.435837 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e142959-45af-4e9c-bbe3-b1c86b31007e req-bc4593b6-8658-4caf-b944-64d071c85597 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1264153 Nov 15 12:43:13.528856 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] Provisioning complete for port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:13.529228 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:13.550815 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0ba44b68-6b7a-4cc9-980c-105f4b038832 req-593e093f-0c7a-4f85-9188-dc99b686e06f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366034 Nov 15 12:43:13.614527 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45f3603-ee22-454b-8167-2babdad54184 None None] Pushing event updated for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:13.621267 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:43:13.622187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:43:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:13.801174 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:43:13.972969 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:14.287032 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2447584-5d77-4beb-a3c4-1215ceb4019b req-37fc909a-eb2f-45d5-a296-db9c46b0c766 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:14.291812 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f2447584-5d77-4beb-a3c4-1215ceb4019b req-37fc909a-eb2f-45d5-a296-db9c46b0c766 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1582594 Nov 15 12:43:14.392936 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f2447584-5d77-4beb-a3c4-1215ceb4019b req-b55ea07f-aee3-4719-ae4c-de621961d804 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904415 Nov 15 12:43:14.675159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89ca756-9313-4787-ad2f-bfc3cec775f0 req-b9c613e8-978d-4df3-9ab7-094744a67cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:14.678306 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] For port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:14.679664 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d89ca756-9313-4787-ad2f-bfc3cec775f0 req-b9c613e8-978d-4df3-9ab7-094744a67cc6 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 1098 time: 0.1691964 Nov 15 12:43:14.681719 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:14.690023 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:14.871336 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d364b2ef-9008-4465-b5eb-9dfdc66d2a00 req-e1e84b2d-0cdc-4fdb-87f6-a66eb5f1c6e3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:14.875604 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d364b2ef-9008-4465-b5eb-9dfdc66d2a00 req-e1e84b2d-0cdc-4fdb-87f6-a66eb5f1c6e3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1350093 Nov 15 12:43:14.951274 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d89ca756-9313-4787-ad2f-bfc3cec775f0 req-742566b8-3596-4594-8d83-a63d8230119e service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2362626 Nov 15 12:43:14.954395 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-d83a45ce-b165-465e-9fc3-e31bff6bd9f3 None None] Provisioning complete for port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:14.955511 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d83a45ce-b165-465e-9fc3-e31bff6bd9f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:15.007113 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d364b2ef-9008-4465-b5eb-9dfdc66d2a00 req-da9b127f-1e62-4a85-9a43-7e190ae4aeb1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151490 Nov 15 12:43:15.008640 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9334f8a2-3545-47e6-a5c4-6e0bf251f88e req-abe04757-d553-4bd2-9733-0ba9a23abf47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:15.011453 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9334f8a2-3545-47e6-a5c4-6e0bf251f88e req-abe04757-d553-4bd2-9733-0ba9a23abf47 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2981124 Nov 15 12:43:15.063754 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbdae211-92dc-4bfb-8d41-aab34d7ca46d None None] Pushing event updated for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:15.147994 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9334f8a2-3545-47e6-a5c4-6e0bf251f88e req-6ddb18e9-0f55-468d-adb2-21e7d7947d65 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1148429 Nov 15 12:43:15.193195 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:43:03Z', 'revision_number': 4, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '9e3e5a57-202b-4956-9bfa-1efe13e22ab3', 'name': '', 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'mac_address': 'fa:16:3e:e2:4c:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 439, 'fixed_ips': [{'subnet_id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:43:00Z', 'updated_at': '2021-11-15T12:43:13Z', 'revision_number': 4, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'subnets': [{'id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:43:15.259855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb399538-4306-4eb5-ac82-efab7e3e9ff7 None None] The sync data for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi is: [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:43:03Z', 'revision_number': 4, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '9e3e5a57-202b-4956-9bfa-1efe13e22ab3', 'name': '', 'network_id': '6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'mac_address': 'fa:16:3e:e2:4c:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_interface', 'standard_attr_id': 439, 'fixed_ips': [{'subnet_id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:43:00Z', 'updated_at': '2021-11-15T12:43:13Z', 'revision_number': 4, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'subnets': [{'id': '33272a70-5cfb-4c4a-a5ae-771ac2aef484', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:43:15.726883 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a4f6f9c-c405-4ca4-a98e-7424c7f0b027 req-ed71cda1-18ea-46f9-bb89-0974d5cc7044 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:15.745312 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a4f6f9c-c405-4ca4-a98e-7424c7f0b027 req-ed71cda1-18ea-46f9-bb89-0974d5cc7044 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1934621 Nov 15 12:43:15.888694 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2a4f6f9c-c405-4ca4-a98e-7424c7f0b027 req-7d7df4ac-aac5-4c5d-beaf-9c126dd189fd tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1382797 Nov 15 12:43:16.049028 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99808f4-94bf-444b-aa16-80d8826ca38e req-216903c4-7432-4629-af6b-627f84ae7da0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:16.051828 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b99808f4-94bf-444b-aa16-80d8826ca38e req-216903c4-7432-4629-af6b-627f84ae7da0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0973725 Nov 15 12:43:16.165302 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b99808f4-94bf-444b-aa16-80d8826ca38e req-04663bf8-e676-41fa-9821-d5bdca73a5ab tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062295 Nov 15 12:43:16.396505 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96c1bbd-aea4-4fd1-9cd5-0b57a39b3f1f req-b3b6e47a-fead-426b-bfba-5e93ad47b78d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:16.398199 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d96c1bbd-aea4-4fd1-9cd5-0b57a39b3f1f req-b3b6e47a-fead-426b-bfba-5e93ad47b78d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1658254 Nov 15 12:43:16.452366 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c3756f-ec0e-4db6-81ad-46d741cf8b59 req-6ded0255-502a-4f60-afc9-dc88203f5470 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:16.462398 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b2c3756f-ec0e-4db6-81ad-46d741cf8b59 req-6ded0255-502a-4f60-afc9-dc88203f5470 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1388843 Nov 15 12:43:16.551414 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d96c1bbd-aea4-4fd1-9cd5-0b57a39b3f1f req-bc79ac12-acbb-4ea9-a9da-78c4dc03ff70 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440866 Nov 15 12:43:16.595195 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b2c3756f-ec0e-4db6-81ad-46d741cf8b59 req-07664835-769f-4827-80ee-7250a91898a3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1316960 Nov 15 12:43:16.680006 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:16.770191 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:16.770931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:17.151096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23743b8-95ae-41ff-8cbb-8f5536db45e8 req-35482084-e334-4622-8320-0d0fb43ed3ad tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:17.160267 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f23743b8-95ae-41ff-8cbb-8f5536db45e8 req-35482084-e334-4622-8320-0d0fb43ed3ad tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1068583 Nov 15 12:43:17.254659 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f23743b8-95ae-41ff-8cbb-8f5536db45e8 req-d03b0f32-e830-41ad-a434-7a34ee90cfd1 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933294 Nov 15 12:43:17.455791 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc580a6-9690-4f32-b087-1b29103a23c5 req-57367e7e-cffb-41be-b757-50aa16615c1e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:17.468592 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cc580a6-9690-4f32-b087-1b29103a23c5 req-57367e7e-cffb-41be-b757-50aa16615c1e tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.1386526 Nov 15 12:43:17.572743 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cc580a6-9690-4f32-b087-1b29103a23c5 req-9f6373d3-fa86-4925-acd8-8b3fd3cecc22 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026542 Nov 15 12:43:17.762604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22cac9e4-e390-4f0e-859c-4c5cc69b4be2 req-ec285815-b5de-4c12-b80c-bb95f1ff3b13 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:17.777844 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-22cac9e4-e390-4f0e-859c-4c5cc69b4be2 req-ec285815-b5de-4c12-b80c-bb95f1ff3b13 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0975797 Nov 15 12:43:17.870333 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172f2fc5-b977-401a-ae51-fe5350f7e01c req-c75e5adf-59c2-4aa0-89cd-a32f8536d6b8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:17.871176 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-22cac9e4-e390-4f0e-859c-4c5cc69b4be2 req-c046bac5-41aa-4257-8ff4-728f2a7a01fa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920370 Nov 15 12:43:17.884063 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-172f2fc5-b977-401a-ae51-fe5350f7e01c req-c75e5adf-59c2-4aa0-89cd-a32f8536d6b8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1306155 Nov 15 12:43:18.003107 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-172f2fc5-b977-401a-ae51-fe5350f7e01c req-0b598d93-1fed-4232-927b-fd76fb586734 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1162639 Nov 15 12:43:18.422875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade2b40f-6303-4fc3-9ea4-409707ce1596 req-52eb72f3-359b-450d-be39-0f6688fadb5b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:18.425461 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ade2b40f-6303-4fc3-9ea4-409707ce1596 req-52eb72f3-359b-450d-be39-0f6688fadb5b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0848663 Nov 15 12:43:18.576048 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ade2b40f-6303-4fc3-9ea4-409707ce1596 req-c874f921-89f7-48e5-99b9-d0b2e1ca84ad tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1410468 Nov 15 12:43:18.822435 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a619c36-0ad6-4621-82f2-cd9599869b0a req-d5b16913-a92e-4b43-bfc1-9374c5287dab tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:18.831162 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a619c36-0ad6-4621-82f2-cd9599869b0a req-d5b16913-a92e-4b43-bfc1-9374c5287dab tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.1657178 Nov 15 12:43:18.918549 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6a619c36-0ad6-4621-82f2-cd9599869b0a req-c7b2050c-2b18-4554-90a3-7f6494167b3d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751190 Nov 15 12:43:18.996847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f7b23e-e213-4b49-95d9-84dcb6d804e2 req-3d8c2809-10cb-43b2-9442-9eaf719185e1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:19.004303 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-81f7b23e-e213-4b49-95d9-84dcb6d804e2 req-3d8c2809-10cb-43b2-9442-9eaf719185e1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0651677 Nov 15 12:43:19.067014 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-81f7b23e-e213-4b49-95d9-84dcb6d804e2 req-40756d58-a6f2-483e-ba5e-05a95c7fc029 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612926 Nov 15 12:43:19.265075 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b440be-4e70-4b48-9e2b-4a4b7e6130c1 req-e6231a4a-aae5-457d-b23b-0408c558dc68 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:19.266658 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-06b440be-4e70-4b48-9e2b-4a4b7e6130c1 req-e6231a4a-aae5-457d-b23b-0408c558dc68 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1304693 Nov 15 12:43:19.329367 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-06b440be-4e70-4b48-9e2b-4a4b7e6130c1 req-4d644cfb-ad24-4a6d-93f4-c7d81b6b7be3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542507 Nov 15 12:43:19.748047 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da8d68c9-aacc-4a95-9f9a-225d5f5de168 req-69174569-d269-4da7-9a4f-e942f20d23d5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:19.749579 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da8d68c9-aacc-4a95-9f9a-225d5f5de168 req-69174569-d269-4da7-9a4f-e942f20d23d5 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0637398 Nov 15 12:43:19.837457 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da8d68c9-aacc-4a95-9f9a-225d5f5de168 req-7e23a28f-0348-4574-92cc-22122f51e152 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786602 Nov 15 12:43:20.145706 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac32e918-91f2-4d0e-9ef1-ea7d3666edde req-af81b44a-2652-4810-976f-ff92a951a56a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:20.147724 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ac32e918-91f2-4d0e-9ef1-ea7d3666edde req-af81b44a-2652-4810-976f-ff92a951a56a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.1241720 Nov 15 12:43:20.422806 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f67400-0600-401d-82e5-c9568a41fac8 req-c6a06e2b-2749-44a6-8fd3-2e7e09016c2d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:20.439622 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f7f67400-0600-401d-82e5-c9568a41fac8 req-c6a06e2b-2749-44a6-8fd3-2e7e09016c2d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1845036 Nov 15 12:43:20.536573 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f7f67400-0600-401d-82e5-c9568a41fac8 req-f8f3546c-454a-4cca-b37e-4fa633066437 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949492 Nov 15 12:43:20.655245 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ac32e918-91f2-4d0e-9ef1-ea7d3666edde req-8f5e0f48-7de1-482e-8319-a72327a918f3 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4986382 Nov 15 12:43:20.864304 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549d4c88-741d-4853-8a74-72913b6e95d1 req-4ccf3777-4eda-4264-9578-8729ee406050 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:20.868059 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-549d4c88-741d-4853-8a74-72913b6e95d1 req-4ccf3777-4eda-4264-9578-8729ee406050 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1076860 Nov 15 12:43:21.008890 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-549d4c88-741d-4853-8a74-72913b6e95d1 req-93db35c3-a0cf-40c9-aa66-fe02b2f8d601 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1165826 Nov 15 12:43:21.127394 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-7c46a502-34c3-404b-a506-56421c42c6e5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:21.142844 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-7c46a502-34c3-404b-a506-56421c42c6e5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.1545458 Nov 15 12:43:21.568166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Deleting port a106f2a9-c144-4b28-9287-b71a667e6786 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:43:21.568941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:21.600468 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58babe3a-d72a-4679-8ea5-e75a65bf4d70 req-1a54834d-9f24-4941-8699-c7ec8a6ea8bd tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:21.614795 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-58babe3a-d72a-4679-8ea5-e75a65bf4d70 req-1a54834d-9f24-4941-8699-c7ec8a6ea8bd tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1706984 Nov 15 12:43:21.767755 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:43:21.800324 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111df5bf-6a77-4098-bfb1-35be3491f573 req-38443c6f-140e-4eea-b19e-c01564c35063 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:21.801849 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-111df5bf-6a77-4098-bfb1-35be3491f573 req-38443c6f-140e-4eea-b19e-c01564c35063 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1150086 Nov 15 12:43:21.843081 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] For port a106f2a9-c144-4b28-9287-b71a667e6786, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=a106f2a9-c144-4b28-9287-b71a667e6786,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:21.843446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:21.862273 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-58babe3a-d72a-4679-8ea5-e75a65bf4d70 req-d0015151-d550-4db6-9ea8-c85770833e88 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1184459 Nov 15 12:43:21.880771 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-111df5bf-6a77-4098-bfb1-35be3491f573 req-3cc70064-11b5-4fe7-a8af-5e9d16f2fb7c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682669 Nov 15 12:43:21.882489 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Calling delete_port for a106f2a9-c144-4b28-9287-b71a667e6786 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:43:22.080687 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e57ee80e-807f-42ab-a0a9-59845c1df7c5 req-4a0b4764-e508-4fe6-9399-9cd78a3fb4f1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:22.083180 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e57ee80e-807f-42ab-a0a9-59845c1df7c5 req-4a0b4764-e508-4fe6-9399-9cd78a3fb4f1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 945 time: 0.0987680 Nov 15 12:43:22.258582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-66cb2edf-265a-4da4-8889-5e4b7aa12e80 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:22.261192 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-66cb2edf-265a-4da4-8889-5e4b7aa12e80 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 813 time: 0.2499638 Nov 15 12:43:22.262852 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e57ee80e-807f-42ab-a0a9-59845c1df7c5 req-75ad43d1-d3db-4840-bc2f-e8c1f7656937 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1695061 Nov 15 12:43:22.266467 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:22.290782 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-3407c04f-ac4c-4248-a5b0-a057ec0c6cf9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/quotas/df44545940f44d95ad307aa0fea120c4 HTTP/1.1" status: 200 len: 375 time: 0.0117984 Nov 15 12:43:22.327002 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670', '9e843abc-71ca-433a-a92b-f035c2503fb4'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:43:22.351848 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event deleted for resources: {'Port': ['ID=a106f2a9-c144-4b28-9287-b71a667e6786,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:22.487215 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-beddd8d7-2fc7-4097-8c20-dde939c8df3e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1749229 Nov 15 12:43:22.605641 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] No DVR routers for this DVR port a106f2a9-c144-4b28-9287-b71a667e6786 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:43:22.618578 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:22.622401 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6de781f0-2dea-4f99-8d22-7cd2a10de9ee req-df6c2045-39ad-4370-9958-70e8f7dc0189 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "DELETE /v2.0/ports/a106f2a9-c144-4b28-9287-b71a667e6786 HTTP/1.1" status: 204 len: 173 time: 1.4579711 Nov 15 12:43:22.622925 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'name': 'network-vif-deleted', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:22.625399 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9925546e-7360-43e0-958c-1a5b1db7fc16" -d '{"events": [{"server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "name": "network-vif-deleted", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:22.674804 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581c2429-6e71-4ec8-8b0a-774879a4c606 req-90ddfb4d-5913-4d48-954f-61c05942620e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:22.676754 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-581c2429-6e71-4ec8-8b0a-774879a4c606 req-90ddfb4d-5913-4d48-954f-61c05942620e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.2954469 Nov 15 12:43:22.701040 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-58a9b25c-6d47-43a3-b035-4e9cfac31bcd service neutron] 10.222.0.44 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1954515 Nov 15 12:43:22.769742 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-581c2429-6e71-4ec8-8b0a-774879a4c606 req-c3b95cc4-f636-42b0-8970-dfa090199c14 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0843055 Nov 15 12:43:22.841004 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-c24f7638-0bc1-4e1c-be9b-e9f485c39401 service neutron] 10.222.0.44 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1376457 Nov 15 12:43:22.868615 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27fd9529-e2c4-456f-873d-8d1757a94f90 x-openstack-request-id: req-27fd9529-e2c4-456f-873d-8d1757a94f90 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:22.869211 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d02a0e4f-72a2-42b6-82d6-656743432d3f", "name": "network-vif-deleted", "tag": "a106f2a9-c144-4b28-9287-b71a667e6786", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:22.869731 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-27fd9529-e2c4-456f-873d-8d1757a94f90 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:22.870478 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd02a0e4f-72a2-42b6-82d6-656743432d3f', 'name': 'network-vif-deleted', 'tag': 'a106f2a9-c144-4b28-9287-b71a667e6786', 'status': 'completed', 'code': 200} Nov 15 12:43:23.070258 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-48e454fb-c527-4d6e-9c16-72b775f9ebf6 req-dc590581-d0bf-41b7-90c0-c81acb79ef7c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 210 time: 0.0356224 Nov 15 12:43:23.110011 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e60c7b0-401c-488a-b684-2307dc43188f req-58cb946c-24c1-441c-b184-1e0771004d87 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:23.113260 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7e60c7b0-401c-488a-b684-2307dc43188f req-58cb946c-24c1-441c-b184-1e0771004d87 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1303821 Nov 15 12:43:23.211143 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7e60c7b0-401c-488a-b684-2307dc43188f req-2f848ff7-86b2-4efc-8caf-78878f345334 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796716 Nov 15 12:43:23.421233 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1a47fe43-2a37-4fc8-921f-82c854dc98cb req-3c052f42-dea1-4e18-adc6-3fc057e49b14 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=d02a0e4f-72a2-42b6-82d6-656743432d3f HTTP/1.1" status: 200 len: 210 time: 0.0456729 Nov 15 12:43:23.553477 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a8315b-0a11-4e24-8e37-365b211fc9d2 req-26c8ec94-d208-408f-903b-63a4e41fd806 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:23.556502 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-02a8315b-0a11-4e24-8e37-365b211fc9d2 req-26c8ec94-d208-408f-903b-63a4e41fd806 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0686150 Nov 15 12:43:23.603843 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-c6676483-9ccb-4140-8ed5-78086b27d549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:23.606674 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-c6676483-9ccb-4140-8ed5-78086b27d549 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1098 time: 0.0568357 Nov 15 12:43:23.633713 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-02a8315b-0a11-4e24-8e37-365b211fc9d2 req-c8810613-eb44-4e19-b20a-18e55e0e5362 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699928 Nov 15 12:43:23.797028 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-3f5793ff-3512-4fd5-851a-e16109695418 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:23.799934 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-3f5793ff-3512-4fd5-851a-e16109695418 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.1664245 Nov 15 12:43:24.034955 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-4f4cdb16-5448-4b0a-8ca6-ec14f19a7969 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 1001 time: 0.1993189 Nov 15 12:43:24.053037 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b15445-8f3d-4afd-b316-a9b71db21266 req-bd85d310-8771-405c-bed6-aac3108c7dfe tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.054839 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-79b15445-8f3d-4afd-b316-a9b71db21266 req-bd85d310-8771-405c-bed6-aac3108c7dfe tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1217437 Nov 15 12:43:24.081490 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device a106f2a9-c144-4b28-9287-b71a667e6786 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:24.121125 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: a106f2a9-c144-4b28-9287-b71a667e6786 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:43:24.121591 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device a106f2a9-c144-4b28-9287-b71a667e6786 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:43:24.158027 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-79b15445-8f3d-4afd-b316-a9b71db21266 req-37165c05-97d7-4b50-862d-9f07935699df tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0938177 Nov 15 12:43:24.163946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-90163553-db37-4659-86ce-9fe5ba0b1d65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.165835 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-90163553-db37-4659-86ce-9fe5ba0b1d65 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0686924 Nov 15 12:43:24.262889 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b0e1ee6c-b55b-4044-a9fc-35e859d7d39f req-5c23fa54-4ba4-43f5-80bc-31e88fb80e0b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 210 time: 0.0513048 Nov 15 12:43:24.287217 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-4bdfca52-db9e-4b9d-9f05-119eee69646b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.289518 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-4bdfca52-db9e-4b9d-9f05-119eee69646b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1080763 Nov 15 12:43:24.465779 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a406b522-41c8-4964-8750-74f6cb1afdc5 req-e15482ec-40b9-4ace-85bd-b2802d7be9b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.468147 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a406b522-41c8-4964-8750-74f6cb1afdc5 req-e15482ec-40b9-4ace-85bd-b2802d7be9b5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1497071 Nov 15 12:43:24.520564 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-a268c41b-012d-435a-95b9-fd5789db4660 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1989641 Nov 15 12:43:24.557266 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a406b522-41c8-4964-8750-74f6cb1afdc5 req-9c1fe40d-85ad-43ad-b0da-026d8dfe349b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748823 Nov 15 12:43:24.667533 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-144c7a72-76b7-4b06-8d80-bac1d9965b27 req-633bbe46-94d5-473b-9e7c-35667aa8de18 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280205 Nov 15 12:43:24.834115 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63efa5b6-62d3-4252-bcf3-5bdcb34958fc req-f285115a-7257-4819-8493-e025b6b08326 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.836330 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63efa5b6-62d3-4252-bcf3-5bdcb34958fc req-f285115a-7257-4819-8493-e025b6b08326 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0693669 Nov 15 12:43:24.862957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8cfa22-8d1d-4b5f-9723-f24b4e414dab req-55996785-abd4-44a8-a342-58f3ab97df49 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:24.864877 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ae8cfa22-8d1d-4b5f-9723-f24b4e414dab req-55996785-abd4-44a8-a342-58f3ab97df49 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0725412 Nov 15 12:43:24.938648 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ae8cfa22-8d1d-4b5f-9723-f24b4e414dab req-e88aaf05-b04b-4016-beca-acb8f4fdd83d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646262 Nov 15 12:43:24.956486 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63efa5b6-62d3-4252-bcf3-5bdcb34958fc req-b881cf1d-e28f-4ff9-96d8-8ca9e562d6f8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086025 Nov 15 12:43:25.153886 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e0cde0e2-8414-4b4a-b869-86c6c89aea76 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:25.157028 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e0cde0e2-8414-4b4a-b869-86c6c89aea76 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 813 time: 0.1756184 Nov 15 12:43:25.223963 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'port': {'device_id': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'admin_state_up': True, 'tenant_id': 'df44545940f44d95ad307aa0fea120c4'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:25.404540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c0da76-f2a1-485c-973f-79f1a68d4129 req-17205e2d-ddde-4254-9581-3c1f3a3a5258 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:25.406468 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e0c0da76-f2a1-485c-973f-79f1a68d4129 req-17205e2d-ddde-4254-9581-3c1f3a3a5258 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 945 time: 0.1133213 Nov 15 12:43:25.418314 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eeb36a61-57c7-4c86-9554-db9614a31711 req-c3e91257-720d-44c6-a371-5102f3284664 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 210 time: 0.0397768 Nov 15 12:43:25.507275 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e0c0da76-f2a1-485c-973f-79f1a68d4129 req-2a5ec893-7e1f-40ef-b862-13e4b696c1f0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877087 Nov 15 12:43:25.541001 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Made reservation on behalf of df44545940f44d95ad307aa0fea120c4 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:43:25.553343 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:25.799961 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Allocated IP 172.20.0.5 (63821a5d-1e37-42d5-95f6-37a0a7410c6f/090fdaf0-419e-4969-a548-0e896cf59fa0/66d80ca0-34c0-4ae9-a96c-a8004410e3af) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:43:25.851290 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d049bb-e366-44c8-9511-4efe736166e2 req-073f71ba-e26f-4c1c-98d9-c83623e13020 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:25.852956 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f7d049bb-e366-44c8-9511-4efe736166e2 req-073f71ba-e26f-4c1c-98d9-c83623e13020 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1529081 Nov 15 12:43:26.060718 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f7d049bb-e366-44c8-9511-4efe736166e2 req-8491770e-eb68-4720-ba3b-7e4feeaec200 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859708 Nov 15 12:43:26.086857 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:26.159860 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:26.300568 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed34fee-3e8b-4615-b45c-90c87de4c5a7 req-0b6a8a93-6526-496b-a66d-4776a68ee001 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:26.304846 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5ed34fee-3e8b-4615-b45c-90c87de4c5a7 req-0b6a8a93-6526-496b-a66d-4776a68ee001 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1997612 Nov 15 12:43:26.312392 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:26.331106 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:26.378489 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:26.380215 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:26.384052 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16b63cfd-19d1-4a9f-a5d8-39e8885af0c4" -d '{"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-unplugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:26.390758 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:26.398764 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:43:26.424666 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8836bff-a8e6-4bb2-8219-5ad256596efe req-8813e133-f691-4f50-ab31-6b6ad7630dc6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:26.438559 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c8836bff-a8e6-4bb2-8219-5ad256596efe req-8813e133-f691-4f50-ab31-6b6ad7630dc6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1961849 Nov 15 12:43:26.456350 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:43:26.463389 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5ed34fee-3e8b-4615-b45c-90c87de4c5a7 req-63a7beb5-667b-468d-b5f6-c09532105042 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521180 Nov 15 12:43:26.503607 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:43:26.527529 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=8']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:26.616015 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd7e4373-a810-4467-bad7-40fa67419225 x-openstack-request-id: req-cd7e4373-a810-4467-bad7-40fa67419225 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:26.617764 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-unplugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:26.618320 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-cd7e4373-a810-4467-bad7-40fa67419225 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:26.619064 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'code': 200} Nov 15 12:43:26.696479 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:26.697790 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:26.720046 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:26.735683 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-360dd510-59a7-4987-882a-70bfd03bb703 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5179710 Nov 15 12:43:26.803337 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c8836bff-a8e6-4bb2-8219-5ad256596efe req-9519dc9e-f130-485c-aead-b333423650f9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3628240 Nov 15 12:43:26.840724 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e066346d-165f-4f22-ab11-9fee9097824f req-01f3731c-a7d0-49b5-805a-25644b502521 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:26.856943 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e066346d-165f-4f22-ab11-9fee9097824f req-01f3731c-a7d0-49b5-805a-25644b502521 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.1365094 Nov 15 12:43:26.949205 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-10a858eb-2234-49ed-992f-0e368753edaf None None] Provisioning complete for port 66d80ca0-34c0-4ae9-a96c-a8004410e3af triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:26.949873 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-10a858eb-2234-49ed-992f-0e368753edaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:27.020443 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e066346d-165f-4f22-ab11-9fee9097824f req-31090439-cd1d-436a-9a5a-9e973621f2a7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1562560 Nov 15 12:43:27.047258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5c7e1f-99fd-4cb0-9ca8-32ccec063821 req-19166301-4176-4a0a-a33f-71337bde5148 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:27.050313 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-10a858eb-2234-49ed-992f-0e368753edaf None None] Port 66d80ca0-34c0-4ae9-a96c-a8004410e3af cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:43:27.058672 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1f5c7e1f-99fd-4cb0-9ca8-32ccec063821 req-19166301-4176-4a0a-a33f-71337bde5148 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1155717 Nov 15 12:43:27.134288 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1f5c7e1f-99fd-4cb0-9ca8-32ccec063821 req-b3f73f1d-5b24-4153-85d2-6a5573c6d3ec tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0714426 Nov 15 12:43:27.256027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf63052-fb70-4169-81e1-05e023088820 req-c79d60a0-2561-4328-9786-600c8b2fa91d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:27.258590 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4bf63052-fb70-4169-81e1-05e023088820 req-c79d60a0-2561-4328-9786-600c8b2fa91d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0688779 Nov 15 12:43:27.314891 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4bf63052-fb70-4169-81e1-05e023088820 req-f73f08d8-db67-4340-aaba-90a19876e636 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502226 Nov 15 12:43:27.696882 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0d7192b-0f65-405c-8dfb-9a5aa2978d30 req-7ef1b514-c3c7-4d60-b2e3-3ff2d9fb1ef1 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:27.699410 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d0d7192b-0f65-405c-8dfb-9a5aa2978d30 req-7ef1b514-c3c7-4d60-b2e3-3ff2d9fb1ef1 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0636630 Nov 15 12:43:27.774379 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d0d7192b-0f65-405c-8dfb-9a5aa2978d30 req-d4b95162-3a82-4fd4-9d95-5270a8ae1ddc tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653334 Nov 15 12:43:27.951799 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c14f4c7-e9cb-49f1-901a-78da62d58b06 req-8e519099-7533-4451-8bac-967f0ff96b46 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:27.953388 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7c14f4c7-e9cb-49f1-901a-78da62d58b06 req-8e519099-7533-4451-8bac-967f0ff96b46 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0595331 Nov 15 12:43:28.052134 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7c14f4c7-e9cb-49f1-901a-78da62d58b06 req-917485a8-50a3-46f0-926e-c840789940df tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866377 Nov 15 12:43:28.248863 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d523ee-4ae6-40ac-a94b-19dae3a31a05 req-57d5f1f5-ef26-47e8-879f-20ae29ce0614 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:28.250498 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a1d523ee-4ae6-40ac-a94b-19dae3a31a05 req-57d5f1f5-ef26-47e8-879f-20ae29ce0614 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.1022153 Nov 15 12:43:28.313002 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8240adc8-b1f2-43dd-ab91-cdb16f474576 req-b951644e-3173-48ad-8257-8c556f1e9969 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:28.314950 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8240adc8-b1f2-43dd-ab91-cdb16f474576 req-b951644e-3173-48ad-8257-8c556f1e9969 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0725787 Nov 15 12:43:28.320350 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a1d523ee-4ae6-40ac-a94b-19dae3a31a05 req-68036c99-2b1d-40a4-a601-2658769bbb5b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612972 Nov 15 12:43:28.372901 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8240adc8-b1f2-43dd-ab91-cdb16f474576 req-68d51a50-3f00-413e-87e2-c15b264d9bfc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514340 Nov 15 12:43:28.530850 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e71903f-881d-49f8-b6d6-78b2b377da08 req-b181ea2e-e305-4ee5-a9b6-4aed8226a21c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:28.532796 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7e71903f-881d-49f8-b6d6-78b2b377da08 req-b181ea2e-e305-4ee5-a9b6-4aed8226a21c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0828214 Nov 15 12:43:28.592245 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7e71903f-881d-49f8-b6d6-78b2b377da08 req-601198b1-b7ec-4b5b-ba6e-aa61f6c4f163 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492890 Nov 15 12:43:28.991593 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c35add-d84a-40ac-b81b-22bf037c47fc req-5085db0b-52a7-47b4-b6c3-9e434d771298 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:28.993735 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-43c35add-d84a-40ac-b81b-22bf037c47fc req-5085db0b-52a7-47b4-b6c3-9e434d771298 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0968111 Nov 15 12:43:29.057475 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-43c35add-d84a-40ac-b81b-22bf037c47fc req-310640f8-ad58-4069-ade2-6f2f3bf534ce tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570233 Nov 15 12:43:29.178663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e04c15-190e-4cd4-a61b-9938fcb98d89 req-96749b0d-27bf-4de5-bd1e-a6c73acccce5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:29.180210 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-03e04c15-190e-4cd4-a61b-9938fcb98d89 req-96749b0d-27bf-4de5-bd1e-a6c73acccce5 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0566871 Nov 15 12:43:29.243552 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-03e04c15-190e-4cd4-a61b-9938fcb98d89 req-b0ec02c6-6127-4db6-8722-c60c31581d38 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547183 Nov 15 12:43:29.499071 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51751753-6b7f-4424-aa8b-5e92d0b0752a req-27b3cc5f-bd85-4b39-8355-b5579b38dcf1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:29.500519 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-51751753-6b7f-4424-aa8b-5e92d0b0752a req-27b3cc5f-bd85-4b39-8355-b5579b38dcf1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0777602 Nov 15 12:43:29.577367 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-51751753-6b7f-4424-aa8b-5e92d0b0752a req-bc733a5b-89be-4d42-8b18-b5a21084ebec tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692313 Nov 15 12:43:29.584604 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8219d3dd-cced-46fc-a7b6-681d8cc8e490 req-737e279e-14de-421c-b4e2-573303da3a06 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:29.596768 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8219d3dd-cced-46fc-a7b6-681d8cc8e490 req-737e279e-14de-421c-b4e2-573303da3a06 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1067433 Nov 15 12:43:29.666912 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8219d3dd-cced-46fc-a7b6-681d8cc8e490 req-5f2d6c44-0c86-4de3-9124-33fe3560f4fa tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0617807 Nov 15 12:43:29.779794 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e29065c-a343-4465-8320-93b9e1f7f163 req-83298dc6-32fe-4ec1-b0a3-40aefa75b1c8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:29.781925 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8e29065c-a343-4465-8320-93b9e1f7f163 req-83298dc6-32fe-4ec1-b0a3-40aefa75b1c8 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1056461 Nov 15 12:43:29.878549 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8e29065c-a343-4465-8320-93b9e1f7f163 req-4da20772-329a-4373-a96e-cea5b3824542 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849731 Nov 15 12:43:30.262567 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aac595a-f76d-4a62-b7e6-7fde9e902d8d req-ecde595d-12a9-4226-b56e-c7ffebb86b19 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:30.297642 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0aac595a-f76d-4a62-b7e6-7fde9e902d8d req-ecde595d-12a9-4226-b56e-c7ffebb86b19 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1604517 Nov 15 12:43:30.404573 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0aac595a-f76d-4a62-b7e6-7fde9e902d8d req-4f94de75-8bd8-4e0f-8d72-0912405e5c51 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043148 Nov 15 12:43:30.476871 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d9d06c0-a7d8-49a9-a1b6-da086db9d6b1 req-0e3025c6-f187-4fe4-909a-542a430244ee tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:30.479008 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d9d06c0-a7d8-49a9-a1b6-da086db9d6b1 req-0e3025c6-f187-4fe4-909a-542a430244ee tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0827878 Nov 15 12:43:30.542722 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d9d06c0-a7d8-49a9-a1b6-da086db9d6b1 req-444edd09-1211-42f9-ab5d-29eae348a713 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571902 Nov 15 12:43:30.755621 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e409fb-6a48-46fb-a641-89edd0242dc8 req-1a1bbeb6-ef7f-44e3-a495-ad0a72e066af tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:30.759050 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-54e409fb-6a48-46fb-a641-89edd0242dc8 req-1a1bbeb6-ef7f-44e3-a495-ad0a72e066af tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0906689 Nov 15 12:43:30.822662 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-54e409fb-6a48-46fb-a641-89edd0242dc8 req-eb80a0da-f68e-461f-88f0-d2e1d97ed00d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532246 Nov 15 12:43:30.867924 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61992370-b2df-4246-9ff6-06cc14e30737 req-6cd888b2-249b-4460-a6bf-1e1079b43516 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:30.870494 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-61992370-b2df-4246-9ff6-06cc14e30737 req-6cd888b2-249b-4460-a6bf-1e1079b43516 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0755236 Nov 15 12:43:30.980732 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-61992370-b2df-4246-9ff6-06cc14e30737 req-ae7f3e9b-dd4a-45f0-a1cf-5a658fd34aa5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1015110 Nov 15 12:43:31.057271 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6b1f71-f8f9-4aa0-8284-fbfa0b079818 req-8bca8e78-1d6d-4212-adb0-5ba124198539 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:31.058799 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d6b1f71-f8f9-4aa0-8284-fbfa0b079818 req-8bca8e78-1d6d-4212-adb0-5ba124198539 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0654507 Nov 15 12:43:31.112390 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d6b1f71-f8f9-4aa0-8284-fbfa0b079818 req-0deb9b73-6401-41b0-b65c-7cad0c2d65ef tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460541 Nov 15 12:43:31.612715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f30aaf3-d797-4c22-af9d-5c6ff02fd92f req-2fa82a39-6d0c-4ac5-9677-6d157513d6b1 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:31.621616 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f30aaf3-d797-4c22-af9d-5c6ff02fd92f req-2fa82a39-6d0c-4ac5-9677-6d157513d6b1 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0818324 Nov 15 12:43:31.709418 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f30aaf3-d797-4c22-af9d-5c6ff02fd92f req-df14c54d-052b-472b-8697-8c7294015634 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842621 Nov 15 12:43:31.742408 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64739f14-660b-4f31-b3c6-c308604d06c9 req-4fe9ea4d-b151-478b-bdac-95a8e527b7d3 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:31.744569 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-64739f14-660b-4f31-b3c6-c308604d06c9 req-4fe9ea4d-b151-478b-bdac-95a8e527b7d3 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0795701 Nov 15 12:43:31.816911 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-64739f14-660b-4f31-b3c6-c308604d06c9 req-cedcefad-872c-4402-bdf0-9872ccd1746d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641427 Nov 15 12:43:31.982861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c25964-8ebf-4e22-84f6-ad147dd29a88 req-e444e38e-f6e0-4ffc-97ce-1823584956c1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:31.984415 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-92c25964-8ebf-4e22-84f6-ad147dd29a88 req-e444e38e-f6e0-4ffc-97ce-1823584956c1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0597723 Nov 15 12:43:32.041317 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-92c25964-8ebf-4e22-84f6-ad147dd29a88 req-9e528bb8-f513-42e2-b49d-be7a15c7329b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494914 Nov 15 12:43:32.176430 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6070d454-08dc-4bc2-8b4e-fae8fa538617 req-a2b9b016-6d80-4d1e-82cc-a1f2ab85de4e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:32.177983 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6070d454-08dc-4bc2-8b4e-fae8fa538617 req-a2b9b016-6d80-4d1e-82cc-a1f2ab85de4e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0944414 Nov 15 12:43:32.240154 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6070d454-08dc-4bc2-8b4e-fae8fa538617 req-166ff333-fc2d-4510-b78e-f37d15ea4daa tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548098 Nov 15 12:43:32.254694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859d6acf-878a-4371-a164-ff003f1bffe0 req-2b9f2ac9-eae2-4e35-962f-845fcdbb579b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:32.256415 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-859d6acf-878a-4371-a164-ff003f1bffe0 req-2b9f2ac9-eae2-4e35-962f-845fcdbb579b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0536110 Nov 15 12:43:32.311394 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-859d6acf-878a-4371-a164-ff003f1bffe0 req-364c6799-670b-4501-9c09-09c665f6cb72 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452964 Nov 15 12:43:32.869077 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf9e0af-c62e-4f93-9051-d662ef87b3bd req-ebe272fe-5333-4f5e-804e-73c54fae84d0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:32.872341 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2bf9e0af-c62e-4f93-9051-d662ef87b3bd req-ebe272fe-5333-4f5e-804e-73c54fae84d0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0787430 Nov 15 12:43:32.965307 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2bf9e0af-c62e-4f93-9051-d662ef87b3bd req-2d6e0936-4e25-4e9c-9e98-3d4ed71e1ed0 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818956 Nov 15 12:43:33.080042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f801d0ce-1050-419d-b5fa-be5549b0d8a6 req-3919017a-d791-4252-986a-8e9d060b8293 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:33.081780 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f801d0ce-1050-419d-b5fa-be5549b0d8a6 req-3919017a-d791-4252-986a-8e9d060b8293 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1288917 Nov 15 12:43:33.178403 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f801d0ce-1050-419d-b5fa-be5549b0d8a6 req-6bf62dee-140b-4222-bc1a-4650b02a48a8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834453 Nov 15 12:43:33.215443 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfbce83-ee9e-4886-ad08-2111ad8cd8a6 req-43e3928e-08bf-49b5-a3cd-a0a98af4dce5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:33.217184 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-acfbce83-ee9e-4886-ad08-2111ad8cd8a6 req-43e3928e-08bf-49b5-a3cd-a0a98af4dce5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0822868 Nov 15 12:43:33.286471 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-acfbce83-ee9e-4886-ad08-2111ad8cd8a6 req-590bf273-5efe-4f97-8991-9c050b827de9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555248 Nov 15 12:43:33.343388 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2ed8f9f3-684d-4b02-8c8a-2ccff694dbd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:33.471680 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a570787d-1948-4f9f-ae67-3ba95511fbd9 req-6d8abf76-c447-4a60-97b8-da72938e9d7d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:33.479060 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a570787d-1948-4f9f-ae67-3ba95511fbd9 req-6d8abf76-c447-4a60-97b8-da72938e9d7d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1411667 Nov 15 12:43:33.479624 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ac3b62-4948-439e-8ac6-fae719fb3889 req-76f4ac3d-a8e1-4665-b199-414e4b7c5621 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:33.481866 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4ac3b62-4948-439e-8ac6-fae719fb3889 req-76f4ac3d-a8e1-4665-b199-414e4b7c5621 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0771465 Nov 15 12:43:33.535675 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a570787d-1948-4f9f-ae67-3ba95511fbd9 req-b7959dc1-48ec-4846-8684-a3ecd8ebdae5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549231 Nov 15 12:43:33.583000 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b4ac3b62-4948-439e-8ac6-fae719fb3889 req-f74e0633-a8da-434a-b613-9e189a60aa35 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927575 Nov 15 12:43:34.230695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ea8885-579b-4ae4-85d6-82b585fb5651 req-e9aa8508-eb5c-444d-9125-1f1b8ce4d151 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:34.239704 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-96ea8885-579b-4ae4-85d6-82b585fb5651 req-e9aa8508-eb5c-444d-9125-1f1b8ce4d151 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1204517 Nov 15 12:43:34.330669 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-96ea8885-579b-4ae4-85d6-82b585fb5651 req-e8c4fc9b-9d97-4276-bc98-a29410994689 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830107 Nov 15 12:43:34.417806 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edaae8c-2bbb-45ae-be35-8a1becc9a966 req-012bb392-fa87-483b-a796-2107cc29e7b3 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:34.419816 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2edaae8c-2bbb-45ae-be35-8a1becc9a966 req-012bb392-fa87-483b-a796-2107cc29e7b3 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1196132 Nov 15 12:43:34.504348 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2edaae8c-2bbb-45ae-be35-8a1becc9a966 req-e518cdc7-b68a-4265-874d-0209c02a0f19 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693965 Nov 15 12:43:34.585815 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9278f5-2415-4ce9-9e46-96dc4a885e11 req-8ffd43f0-c847-47c8-8499-9aef20220998 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:34.586644 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9f9278f5-2415-4ce9-9e46-96dc4a885e11 req-8ffd43f0-c847-47c8-8499-9aef20220998 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.1067226 Nov 15 12:43:34.680375 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9f9278f5-2415-4ce9-9e46-96dc4a885e11 req-874c3c81-2381-4c1b-b1f4-66ba17d285bb tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812254 Nov 15 12:43:34.729724 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78134b4-b276-4962-ba73-a17c46c863b3 req-10df606e-c0f3-4d30-ad9f-7e9583e9ac04 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:34.740996 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b78134b4-b276-4962-ba73-a17c46c863b3 req-10df606e-c0f3-4d30-ad9f-7e9583e9ac04 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0874550 Nov 15 12:43:34.820371 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36117958-3387-4cb1-a243-63bcf6e3f86e req-cfa4eec2-5f93-43c3-8167-441a73702771 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:34.821950 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-36117958-3387-4cb1-a243-63bcf6e3f86e req-cfa4eec2-5f93-43c3-8167-441a73702771 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0686474 Nov 15 12:43:34.822606 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b78134b4-b276-4962-ba73-a17c46c863b3 req-1c8c1f49-fcdc-408e-838d-a0f112817154 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0774117 Nov 15 12:43:34.881891 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-36117958-3387-4cb1-a243-63bcf6e3f86e req-d0bcc5cd-866f-4d17-9b96-5a03dc86a99b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505881 Nov 15 12:43:35.509470 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835754c0-b955-4ff5-ab74-e67d1ba4ac53 req-0113cc41-ed02-4b6e-bbe9-cd6812cd643d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:35.511025 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-835754c0-b955-4ff5-ab74-e67d1ba4ac53 req-0113cc41-ed02-4b6e-bbe9-cd6812cd643d tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0528691 Nov 15 12:43:35.579971 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-835754c0-b955-4ff5-ab74-e67d1ba4ac53 req-680e9a8b-ca14-4bd8-b53a-e3112fbbd26e tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573533 Nov 15 12:43:35.720992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485df891-efe7-4879-8938-f4efe8b7b410 req-fcbd12b2-0908-4b38-8080-03b57c56e35f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:35.728345 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-485df891-efe7-4879-8938-f4efe8b7b410 req-fcbd12b2-0908-4b38-8080-03b57c56e35f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.1219051 Nov 15 12:43:35.770754 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e0a3dd1a-99cb-4268-aa84-49d032dc43f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:35.813348 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-485df891-efe7-4879-8938-f4efe8b7b410 req-46c92c0a-fda1-494e-b4a0-d0f8a65bfa20 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829105 Nov 15 12:43:35.878872 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f999dea-2979-4180-b9ee-95442cbe7aee req-faebcb15-e646-4857-9bf4-c5be833750e7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:35.881541 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2f999dea-2979-4180-b9ee-95442cbe7aee req-faebcb15-e646-4857-9bf4-c5be833750e7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0957584 Nov 15 12:43:35.958590 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2f999dea-2979-4180-b9ee-95442cbe7aee req-cdb59ddf-5007-438c-a188-4777e7aeb911 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700355 Nov 15 12:43:35.982221 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7892a5-0f7b-4d86-bc72-b48635ce73b5 req-da234663-55cf-4dfe-b886-b933daae6686 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:35.984001 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be7892a5-0f7b-4d86-bc72-b48635ce73b5 req-da234663-55cf-4dfe-b886-b933daae6686 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0597410 Nov 15 12:43:36.057498 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-be7892a5-0f7b-4d86-bc72-b48635ce73b5 req-1cc7e5a8-4fc5-48a8-85b1-d25c7fecfe12 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600047 Nov 15 12:43:36.105964 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e622e1-77ae-4371-9cc6-65ee1917e601 req-3c7ae44a-07dd-41e2-8b5a-95ec4c6eb043 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:36.108573 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-78e622e1-77ae-4371-9cc6-65ee1917e601 req-3c7ae44a-07dd-41e2-8b5a-95ec4c6eb043 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0661259 Nov 15 12:43:36.158821 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-78e622e1-77ae-4371-9cc6-65ee1917e601 req-17e6970a-1b28-4fea-921f-515205399ddb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433660 Nov 15 12:43:36.717434 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69889965-9bbc-4c7d-aad1-4be01bc9b342 req-732fa0f3-3ec4-4a7c-ba82-90ccc6bd9885 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:36.718948 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-69889965-9bbc-4c7d-aad1-4be01bc9b342 req-732fa0f3-3ec4-4a7c-ba82-90ccc6bd9885 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0614238 Nov 15 12:43:36.782093 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-69889965-9bbc-4c7d-aad1-4be01bc9b342 req-e1772a62-125b-47e8-aa30-ac0def18d184 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548999 Nov 15 12:43:36.873546 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:36.985273 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9036e2-0569-44bf-a5fd-9bce9d5dfdd4 req-a010f7aa-3895-414e-92cc-e7346ebb4aa9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:36.987691 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f9036e2-0569-44bf-a5fd-9bce9d5dfdd4 req-a010f7aa-3895-414e-92cc-e7346ebb4aa9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0777280 Nov 15 12:43:37.060493 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f9036e2-0569-44bf-a5fd-9bce9d5dfdd4 req-6f40f3a7-9039-490e-8793-f22957b553d2 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650291 Nov 15 12:43:37.137969 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deece73-59de-4eed-9d5c-d76842252dd1 req-7ad5b2ae-aa87-45fa-bc15-19668159a525 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:37.143552 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0deece73-59de-4eed-9d5c-d76842252dd1 req-7ad5b2ae-aa87-45fa-bc15-19668159a525 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0663364 Nov 15 12:43:37.198594 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0deece73-59de-4eed-9d5c-d76842252dd1 req-41025c85-7508-4561-aebd-286d30afecf8 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523379 Nov 15 12:43:37.250425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af78bc3-2550-44c1-a157-32aa82101fcc req-b3bc529a-17f1-402b-b149-8d18218fe136 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:37.253881 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7af78bc3-2550-44c1-a157-32aa82101fcc req-b3bc529a-17f1-402b-b149-8d18218fe136 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0949786 Nov 15 12:43:37.323080 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7af78bc3-2550-44c1-a157-32aa82101fcc req-9c20498f-1e8f-4fcb-8a67-50c57b20ce30 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0605724 Nov 15 12:43:37.356844 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cac1e3d-4768-44e0-82d9-e13f5ed8b8c9 req-9158121c-d487-4be9-bb62-550146a45c8e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:37.359783 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9cac1e3d-4768-44e0-82d9-e13f5ed8b8c9 req-9158121c-d487-4be9-bb62-550146a45c8e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0570879 Nov 15 12:43:37.454828 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9cac1e3d-4768-44e0-82d9-e13f5ed8b8c9 req-9ef308f4-1595-4aca-a714-c6fe4d97f9c2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790291 Nov 15 12:43:37.959391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d49a540-b11f-4e9d-bc1e-b49170344beb req-fb45f87b-8cb6-4292-908a-706f3713656b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:37.961199 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2d49a540-b11f-4e9d-bc1e-b49170344beb req-fb45f87b-8cb6-4292-908a-706f3713656b tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0791202 Nov 15 12:43:38.014004 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2d49a540-b11f-4e9d-bc1e-b49170344beb req-58258d64-ece4-448e-9fd1-01d0b6f93e50 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457113 Nov 15 12:43:38.217588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24459d5-dfcb-4fe5-a90e-73d24b4a5ae2 req-ab617dc8-16d1-45d4-a04b-f38bbaab6a17 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:38.220290 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f24459d5-dfcb-4fe5-a90e-73d24b4a5ae2 req-ab617dc8-16d1-45d4-a04b-f38bbaab6a17 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0667725 Nov 15 12:43:38.301618 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f24459d5-dfcb-4fe5-a90e-73d24b4a5ae2 req-bea6955d-fc6d-4025-a312-88b20f17af53 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748599 Nov 15 12:43:38.361357 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:38.401855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df108e17-b34f-4919-afc0-0947ed36de1c req-89b3ae0b-7cc9-46fc-b6e0-850ef573ea80 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:38.404305 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df108e17-b34f-4919-afc0-0947ed36de1c req-89b3ae0b-7cc9-46fc-b6e0-850ef573ea80 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0675025 Nov 15 12:43:38.468943 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df108e17-b34f-4919-afc0-0947ed36de1c req-4803faf4-19fa-49a7-93bf-ee28c3a2e325 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573533 Nov 15 12:43:38.486409 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c651063-3c12-446a-91f5-0edb021c495f req-e5340020-f15d-41b4-91c1-7709da0ee799 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:38.488044 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3c651063-3c12-446a-91f5-0edb021c495f req-e5340020-f15d-41b4-91c1-7709da0ee799 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0676389 Nov 15 12:43:38.596462 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3c651063-3c12-446a-91f5-0edb021c495f req-175dc15d-d4f9-44c0-9267-1e4ee5546376 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0969136 Nov 15 12:43:38.641243 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e8dc43-22b4-4425-b325-e41507d31a8b req-9f3951d9-9bb8-4a38-9eac-f73a70cfdd16 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:38.642843 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-31e8dc43-22b4-4425-b325-e41507d31a8b req-9f3951d9-9bb8-4a38-9eac-f73a70cfdd16 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0759504 Nov 15 12:43:38.710814 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-31e8dc43-22b4-4425-b325-e41507d31a8b req-196a538c-dfdb-44fc-bf40-ca5a2f9a1152 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574121 Nov 15 12:43:39.132744 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:39.168181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987d2404-e1cd-4351-84ba-df8de5f9ae64 req-703b35d2-9c36-4783-a0a7-c7870bb1e3de tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:39.169681 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-987d2404-e1cd-4351-84ba-df8de5f9ae64 req-703b35d2-9c36-4783-a0a7-c7870bb1e3de tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0571427 Nov 15 12:43:39.237730 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-987d2404-e1cd-4351-84ba-df8de5f9ae64 req-872b2963-0760-4823-b350-b123f2d78914 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611887 Nov 15 12:43:39.513137 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4e9758-aa02-4f52-bd46-ea4797b39354 req-858b4939-cfd5-48ce-b865-91d21dbc16f8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:39.514733 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5a4e9758-aa02-4f52-bd46-ea4797b39354 req-858b4939-cfd5-48ce-b865-91d21dbc16f8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0851114 Nov 15 12:43:39.596910 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5a4e9758-aa02-4f52-bd46-ea4797b39354 req-dae22ac7-ffda-43aa-9b01-853238ca5e5b tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709543 Nov 15 12:43:39.630695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4933065-6174-4a17-a2c0-077af63b556f req-4c0e638e-6d82-480a-a9e9-b9799a51fd6f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:39.632340 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e4933065-6174-4a17-a2c0-077af63b556f req-4c0e638e-6d82-480a-a9e9-b9799a51fd6f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0543900 Nov 15 12:43:39.698046 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e4933065-6174-4a17-a2c0-077af63b556f req-c0741dcd-34d8-4540-932f-c568a3e3d002 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589793 Nov 15 12:43:39.772838 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7bfe077-16e3-459d-8a27-6b394cc9ccc4 req-2de9644c-e799-4c1e-b97a-d5f0f22eec29 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:39.774984 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c7bfe077-16e3-459d-8a27-6b394cc9ccc4 req-2de9644c-e799-4c1e-b97a-d5f0f22eec29 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0796478 Nov 15 12:43:39.862726 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c7bfe077-16e3-459d-8a27-6b394cc9ccc4 req-10c340cc-6bb8-44f3-8763-c9cab709869a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0772698 Nov 15 12:43:39.870994 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4657dab-183b-4bb2-9d1f-70293ce043a6 req-8cb16865-e29c-4d6f-839e-49146cbeedbf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:39.872543 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f4657dab-183b-4bb2-9d1f-70293ce043a6 req-8cb16865-e29c-4d6f-839e-49146cbeedbf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0752268 Nov 15 12:43:39.954470 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f4657dab-183b-4bb2-9d1f-70293ce043a6 req-4fdfdfad-8085-4077-8aea-e1163aeba79e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685220 Nov 15 12:43:40.401258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabd6d3e-8f3c-4ceb-a426-12bd88f78bfc req-53fb8ce3-3c02-4668-a093-112d93027352 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:40.402925 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fabd6d3e-8f3c-4ceb-a426-12bd88f78bfc req-53fb8ce3-3c02-4668-a093-112d93027352 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0628550 Nov 15 12:43:40.482346 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fabd6d3e-8f3c-4ceb-a426-12bd88f78bfc req-36e0425b-5e2e-4c63-b818-cf9b7c249643 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706990 Nov 15 12:43:40.755416 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c2bcef-ed73-405c-a2ef-429ebe0fb2c4 req-61bca898-3e3c-47ce-be6f-82173811c092 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:40.770535 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-67c2bcef-ed73-405c-a2ef-429ebe0fb2c4 req-61bca898-3e3c-47ce-be6f-82173811c092 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0785077 Nov 15 12:43:40.830011 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-67c2bcef-ed73-405c-a2ef-429ebe0fb2c4 req-1ea9f29c-4447-4f87-bb9e-9ff0afb7cea6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579832 Nov 15 12:43:40.867122 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3dd1ad-b45b-47a5-b956-ef76f8c73b55 req-2d5e85ad-b71a-4c23-8572-9c04fb5b8907 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:40.868721 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bc3dd1ad-b45b-47a5-b956-ef76f8c73b55 req-2d5e85ad-b71a-4c23-8572-9c04fb5b8907 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0666258 Nov 15 12:43:40.921359 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bc3dd1ad-b45b-47a5-b956-ef76f8c73b55 req-52386b02-f4c6-4293-b168-898d87c5a651 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446694 Nov 15 12:43:41.027016 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160aadc4-8629-45c2-8cb3-924227cb81aa req-525343eb-45f2-4f7b-aa9e-60d744e2be02 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:41.029717 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-160aadc4-8629-45c2-8cb3-924227cb81aa req-525343eb-45f2-4f7b-aa9e-60d744e2be02 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0723877 Nov 15 12:43:41.101760 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-160aadc4-8629-45c2-8cb3-924227cb81aa req-e112ab77-704c-4551-a280-c245d23da326 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0627193 Nov 15 12:43:41.130828 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3824cb8-0f25-41a7-af3d-4e6ed3b25bb3 req-468be65f-7a22-4810-a042-65f83e261f92 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:41.132529 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d3824cb8-0f25-41a7-af3d-4e6ed3b25bb3 req-468be65f-7a22-4810-a042-65f83e261f92 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0737183 Nov 15 12:43:41.188213 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d3824cb8-0f25-41a7-af3d-4e6ed3b25bb3 req-cc0f07a1-629c-4abd-8dfa-ee2aa780f80f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469806 Nov 15 12:43:41.639255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12c2654-8b37-40cb-9391-793e247dd7c2 req-e5555484-5bf6-4b8a-9a7e-3f8b6e5b97e2 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:41.640846 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a12c2654-8b37-40cb-9391-793e247dd7c2 req-e5555484-5bf6-4b8a-9a7e-3f8b6e5b97e2 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.0662067 Nov 15 12:43:41.698546 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a12c2654-8b37-40cb-9391-793e247dd7c2 req-168df04c-f1f2-40fb-955a-8cfad6769c94 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510542 Nov 15 12:43:41.969492 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36113ce-c5f9-4b26-aa7d-b3ee4bc8249c req-7bbffa40-3148-43ea-b60e-7941a8dfd138 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:41.971564 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a36113ce-c5f9-4b26-aa7d-b3ee4bc8249c req-7bbffa40-3148-43ea-b60e-7941a8dfd138 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0617487 Nov 15 12:43:42.033010 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a36113ce-c5f9-4b26-aa7d-b3ee4bc8249c req-6a8a1eaf-e71b-4830-a909-88ceb8dab844 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541472 Nov 15 12:43:42.076256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128d6bb9-2635-4a0c-a092-cefd20d50316 req-2aeaadb9-74d8-4e44-a2c7-7ad26ccea653 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.078428 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-128d6bb9-2635-4a0c-a092-cefd20d50316 req-2aeaadb9-74d8-4e44-a2c7-7ad26ccea653 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 931 time: 0.0722802 Nov 15 12:43:42.137833 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-128d6bb9-2635-4a0c-a092-cefd20d50316 req-cf912e55-8097-4a42-9cca-5f67e91b8460 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529108 Nov 15 12:43:42.285348 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51da4334-f892-4830-b303-71c6f61b52c8 req-cfd84e27-af48-44cc-be1d-657e3e7bc03c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.287429 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-51da4334-f892-4830-b303-71c6f61b52c8 req-cfd84e27-af48-44cc-be1d-657e3e7bc03c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0598140 Nov 15 12:43:42.348879 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-51da4334-f892-4830-b303-71c6f61b52c8 req-92e77f6c-55e1-4c34-a8f7-e164302ad569 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548816 Nov 15 12:43:42.355452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1dc9016-52e5-4461-8a4b-15933e372fb7 req-75adf936-1b35-434c-b6e7-70a73bdf1702 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.357353 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f1dc9016-52e5-4461-8a4b-15933e372fb7 req-75adf936-1b35-434c-b6e7-70a73bdf1702 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0760188 Nov 15 12:43:42.373041 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Request body: {'port': {'device_id': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:42.425792 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f1dc9016-52e5-4461-8a4b-15933e372fb7 req-614b9fac-c3e1-43c7-aaf1-07f670768fe1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609157 Nov 15 12:43:42.465290 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:42.635901 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-e1981ff6-967c-4276-a092-22e9df6a07b2 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0679085 Nov 15 12:43:42.769396 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272c9368-37de-40b0-997a-399279dd314c req-b6d967fb-bde2-458b-b8a0-907a63261cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.770999 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-b6d967fb-bde2-458b-b8a0-907a63261cb0 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 1098 time: 0.0714791 Nov 15 12:43:42.896700 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66d80ca0-34c0-4ae9-a96c-a8004410e3af {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:43:42.906247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:42.939737 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272c9368-37de-40b0-997a-399279dd314c req-263af07b-70e1-4868-b424-c320d8644afc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.940273 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Transition to ACTIVE for port object 66d80ca0-34c0-4ae9-a96c-a8004410e3af will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:43:42.943946 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-263af07b-70e1-4868-b424-c320d8644afc service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.1315169 Nov 15 12:43:42.956177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb5efd0-1dcf-4364-a1b7-df27e87fec33 req-830bfcc9-e5f8-4839-bbef-4350cac1b847 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:42.958938 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0fb5efd0-1dcf-4364-a1b7-df27e87fec33 req-830bfcc9-e5f8-4839-bbef-4350cac1b847 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1260843 Nov 15 12:43:42.960943 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:43.065333 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-408d1978-2f76-45c4-9107-538d759458bc service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7 HTTP/1.1" status: 200 len: 217 time: 0.0658283 Nov 15 12:43:43.077233 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:43.127222 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.127663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.128061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.128477 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.128877 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.129271 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.129668 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.130059 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.130446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.130834 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.131232 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.131616 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:43.161759 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0fb5efd0-1dcf-4364-a1b7-df27e87fec33 req-7d1cb864-40f4-443f-ae29-c0b4f92c48d4 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1646554 Nov 15 12:43:43.201120 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Attempting to bind port 66d80ca0-34c0-4ae9-a96c-a8004410e3af on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:43:43.201576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Attempting to bind port 66d80ca0-34c0-4ae9-a96c-a8004410e3af by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:43:43.202013 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Attempting to bind port 66d80ca0-34c0-4ae9-a96c-a8004410e3af on network 63821a5d-1e37-42d5-95f6-37a0a7410c6f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:43.208630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Port 66d80ca0-34c0-4ae9-a96c-a8004410e3af on network 63821a5d-1e37-42d5-95f6-37a0a7410c6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:43:43.211499 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Attempting to bind port 66d80ca0-34c0-4ae9-a96c-a8004410e3af on network 63821a5d-1e37-42d5-95f6-37a0a7410c6f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:43.225154 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 43, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:43:43.225626 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Checking segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:43:43.226129 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Bound using segment: {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:43:43.226718 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Bound port: 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'af347650-18c7-458f-a0a0-a0ae25ae52ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:43:43.227278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:43.333170 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272c9368-37de-40b0-997a-399279dd314c req-994e5f97-a53f-47b1-8738-2bc27603e0d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.334660 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-994e5f97-a53f-47b1-8738-2bc27603e0d6 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.1636233 Nov 15 12:43:43.351698 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-955adc5f-0b91-44fc-bbfb-b73fd4e9c7e5 req-3fd2e115-7322-46c7-8139-89d113e24b86 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.355849 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-955adc5f-0b91-44fc-bbfb-b73fd4e9c7e5 req-3fd2e115-7322-46c7-8139-89d113e24b86 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.2263701 Nov 15 12:43:43.376909 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:43:43.407767 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:43:43.415330 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:43.431238 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-6b5f6857-fd8a-4689-8115-4e3c9f2a0b31 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0707531 Nov 15 12:43:43.452054 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-0db2ec41-1f50-4b85-8e37-edb1d487b910 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.453682 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-0db2ec41-1f50-4b85-8e37-edb1d487b910 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.2026589 Nov 15 12:43:43.465994 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0effaae-d4b9-44df-9fc8-d7184908a556 req-82d6cff1-2bc1-4985-bf7c-501cf9fc25e6 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.467729 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0effaae-d4b9-44df-9fc8-d7184908a556 req-82d6cff1-2bc1-4985-bf7c-501cf9fc25e6 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 943 time: 0.1116621 Nov 15 12:43:43.482305 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.483204 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:43.485004 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] 10.222.0.61 "PUT /v2.0/ports/66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 1093 time: 1.1188016 Nov 15 12:43:43.488528 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:43.494418 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df" -d '{"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:43.537690 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b5ede7-cec3-4b79-8d98-f17669965a3c service neutron] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:43.583388 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0effaae-d4b9-44df-9fc8-d7184908a556 req-e4570f4f-f937-4001-9813-afafb1b4fd53 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030612 Nov 15 12:43:43.661208 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-955adc5f-0b91-44fc-bbfb-b73fd4e9c7e5 req-7529a666-c3fe-4cb2-9d3f-a78f940554a9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2869604 Nov 15 12:43:43.807936 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-b0e99092-2856-43d9-8f98-4e25917c1b8e service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3524189 Nov 15 12:43:43.820326 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-311b7403-92b8-418c-a1f4-228b0b11c82d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.823658 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-311b7403-92b8-418c-a1f4-228b0b11c82d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1096 time: 0.1607914 Nov 15 12:43:43.864279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6105ef9e-9b48-4bb6-898c-2354914c34d6 req-4e2336d2-4535-423d-9f19-aebcce6eeb44 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:43.866730 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6105ef9e-9b48-4bb6-898c-2354914c34d6 req-4e2336d2-4535-423d-9f19-aebcce6eeb44 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1320815 Nov 15 12:43:43.948939 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-4757b7d2-1ac3-4505-91f9-246a0661873e service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 217 time: 0.0808024 Nov 15 12:43:44.005422 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6105ef9e-9b48-4bb6-898c-2354914c34d6 req-2734e203-79ab-4932-9b37-d6d84211703d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1166523 Nov 15 12:43:44.071136 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:44.206414 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Deleting port e7e580cd-1661-4485-bb46-67ecab8410ac {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:43:44.213510 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:44.339850 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc910e4f-306c-4246-afbf-d41f6526d766 x-openstack-request-id: req-fc910e4f-306c-4246-afbf-d41f6526d766 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:44.341064 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:44.341064 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-fc910e4f-306c-4246-afbf-d41f6526d766 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:44.341323 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:43:44.414634 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-e24af491-77ca-488a-ac8e-44ea97bdf673 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5628290 Nov 15 12:43:44.415284 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524c0096-db46-4248-b3b2-6ea65e916f1e req-0e1160ed-bdd3-4b50-a0db-7f926bad4a1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.416464 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-524c0096-db46-4248-b3b2-6ea65e916f1e req-0e1160ed-bdd3-4b50-a0db-7f926bad4a1e service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.0741844 Nov 15 12:43:44.427480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-785896d5-6342-4a6f-b6a5-fdca703cb3b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.429872 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-785896d5-6342-4a6f-b6a5-fdca703cb3b7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.4479756 Nov 15 12:43:44.452255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1940049-2dea-4f36-be36-0a2f2f18e7c1 req-7da03428-6f31-4bca-a7e7-cf0cb9eec029 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.454703 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1940049-2dea-4f36-be36-0a2f2f18e7c1 req-7da03428-6f31-4bca-a7e7-cf0cb9eec029 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.3024490 Nov 15 12:43:44.519669 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] For port e7e580cd-1661-4485-bb46-67ecab8410ac, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e7e580cd-1661-4485-bb46-67ecab8410ac,segment=NetworkSegment(75c34c2d-db36-477f-b460-e981d9675cdd),segment_id=75c34c2d-db36-477f-b460-e981d9675cdd)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:44.520174 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:44.543342 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd1d7c2-5140-4c2e-8268-9e84e464d859 req-7e67dcf4-6fa8-44c7-9592-036f558eced8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.544709 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7cd1d7c2-5140-4c2e-8268-9e84e464d859 req-7e67dcf4-6fa8-44c7-9592-036f558eced8 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 945 time: 0.1108413 Nov 15 12:43:44.550732 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Calling delete_port for e7e580cd-1661-4485-bb46-67ecab8410ac owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:43:44.601614 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1940049-2dea-4f36-be36-0a2f2f18e7c1 req-ba0b0c58-b8d1-497a-9fca-80b66dc7071d tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1260271 Nov 15 12:43:44.608669 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-524c0096-db46-4248-b3b2-6ea65e916f1e req-3364952c-190b-4e4a-82b8-e5bf726b1612 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212609 Nov 15 12:43:44.612628 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-ddf9f855-a17d-449a-b1e1-659f647d1fdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.614380 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-ddf9f855-a17d-449a-b1e1-659f647d1fdb service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1203256 Nov 15 12:43:44.653150 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7cd1d7c2-5140-4c2e-8268-9e84e464d859 req-d8fcbb5d-732a-4e06-8c9a-42856731e3cb tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/security-groups?id=8ab99b9e-d376-49f2-adcc-6257add5d4d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956419 Nov 15 12:43:44.782409 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3caa7e18-9ed6-4f55-bd79-dc68fe956018 req-6b5c6e45-0c1f-4ec0-8218-5e77806e24a0 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.784098 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3caa7e18-9ed6-4f55-bd79-dc68fe956018 req-6b5c6e45-0c1f-4ec0-8218-5e77806e24a0 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 943 time: 0.0653462 Nov 15 12:43:44.798581 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9373d7-f5a7-4911-9134-ffb81fa2791e req-a488b1ce-4b8e-4d58-995a-d311a56c2424 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.800435 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7f9373d7-f5a7-4911-9134-ffb81fa2791e req-a488b1ce-4b8e-4d58-995a-d311a56c2424 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0961440 Nov 15 12:43:44.801554 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:44.844277 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3caa7e18-9ed6-4f55-bd79-dc68fe956018 req-bfb56671-f205-4017-8cad-a8f0345e7a5e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529044 Nov 15 12:43:44.845605 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Pushing event deleted for resources: {'Port': ['ID=e7e580cd-1661-4485-bb46-67ecab8410ac,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:44.885456 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.885801 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.886138 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.886473 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.886800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.887128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.887454 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.887779 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.888875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.888875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.889191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.889379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:43:44.913770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] No DVR routers for this DVR port e7e580cd-1661-4485-bb46-67ecab8410ac on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:43:44.921249 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:44.926206 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c4f11435-984a-45b0-9253-524bec00a4f1 req-bf722c55-7e10-4184-8fed-2ae84f033226 tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.61 "DELETE /v2.0/ports/e7e580cd-1661-4485-bb46-67ecab8410ac HTTP/1.1" status: 204 len: 173 time: 1.4494452 Nov 15 12:43:44.927040 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'name': 'network-vif-deleted', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:44.929565 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39f5b715-3ddf-440c-9a2b-0d621f4b1e4a" -d '{"events": [{"server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "name": "network-vif-deleted", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:44.950163 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7f9373d7-f5a7-4911-9134-ffb81fa2791e req-27609281-ea8e-4bda-8a68-873e4c4a6344 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1398771 Nov 15 12:43:44.975425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c9a65a-a130-448b-af73-fc8d3a6cc054 req-3195df88-0783-4043-bb30-bfcbd57e0daa tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:44.977713 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d6c9a65a-a130-448b-af73-fc8d3a6cc054 req-3195df88-0783-4043-bb30-bfcbd57e0daa tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0651259 Nov 15 12:43:44.999302 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28ca32fc-c069-40db-9689-4126b69060ff x-openstack-request-id: req-28ca32fc-c069-40db-9689-4126b69060ff {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:44.999588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5baea5e3-2418-497f-9ac5-57a25a8172e7", "name": "network-vif-deleted", "tag": "e7e580cd-1661-4485-bb46-67ecab8410ac", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:44.999838 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-28ca32fc-c069-40db-9689-4126b69060ff {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:45.000271 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5baea5e3-2418-497f-9ac5-57a25a8172e7', 'name': 'network-vif-deleted', 'tag': 'e7e580cd-1661-4485-bb46-67ecab8410ac', 'status': 'completed', 'code': 200} Nov 15 12:43:45.045728 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d6c9a65a-a130-448b-af73-fc8d3a6cc054 req-501fd6e3-06b2-4400-903a-d4f298f76bcf tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611098 Nov 15 12:43:45.144692 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-a3b1a3ad-4f21-4fe2-8395-f3a5e599599e service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0977681 Nov 15 12:43:45.202802 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c624f7c1-00f6-4d98-880f-8d4888009777 req-46f9a4d2-6d86-4ab5-b10e-b1726b605a50 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:45.204463 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c624f7c1-00f6-4d98-880f-8d4888009777 req-46f9a4d2-6d86-4ab5-b10e-b1726b605a50 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0563161 Nov 15 12:43:45.264299 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c624f7c1-00f6-4d98-880f-8d4888009777 req-1c27fd5b-0921-4761-9f96-df0aae1ae693 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523386 Nov 15 12:43:45.398487 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f363667-1202-4ac6-b440-620fc12cd167 req-927a3984-f275-421c-beef-6d6949756820 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:45.400095 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3f363667-1202-4ac6-b440-620fc12cd167 req-927a3984-f275-421c-beef-6d6949756820 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 945 time: 0.0675616 Nov 15 12:43:45.428701 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9a9ed2b-8147-4f31-ac0b-e6bccde600b8 req-ce4e000b-4e72-4c6a-aa5e-c9c810972341 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1215322 Nov 15 12:43:45.556102 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Deleting port 9e843abc-71ca-433a-a92b-f035c2503fb4 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:43:45.556860 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:45.647593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-7a3c74ea-af61-4756-a531-8c25c4507a37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:45.650235 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-7a3c74ea-af61-4756-a531-8c25c4507a37 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1096 time: 0.0812085 Nov 15 12:43:45.704535 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] For port 9e843abc-71ca-433a-a92b-f035c2503fb4, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9e843abc-71ca-433a-a92b-f035c2503fb4,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:45.706571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:45.722680 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Calling delete_port for 9e843abc-71ca-433a-a92b-f035c2503fb4 owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:43:45.840715 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2d4ab507-a7b5-4510-80c7-7f1014715fb1 req-c8d28d87-530a-4cb2-8837-436715f52ebe tempest-VolumesActionsTest-464254077 tempest-VolumesActionsTest-464254077-project] 10.222.0.44 "GET /v2.0/ports?device_id=5baea5e3-2418-497f-9ac5-57a25a8172e7 HTTP/1.1" status: 200 len: 210 time: 0.0489569 Nov 15 12:43:45.862955 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c3b3ba-cb73-4224-a461-a6e7ac83fe5f req-74b05e60-d320-4ffc-a17e-34f2ba39d3b1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:45.866485 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d5c3b3ba-cb73-4224-a461-a6e7ac83fe5f req-74b05e60-d320-4ffc-a17e-34f2ba39d3b1 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1612887 Nov 15 12:43:46.017700 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-85845d6b-5e40-4ec4-b2b9-39c8ad399b91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.020262 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-85845d6b-5e40-4ec4-b2b9-39c8ad399b91 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.2820821 Nov 15 12:43:46.025325 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d5c3b3ba-cb73-4224-a461-a6e7ac83fe5f req-2b08d483-d7d4-42f6-b7b5-042511d428ee tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1248026 Nov 15 12:43:46.085687 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:46.109013 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-0cee0cfe-8f39-4107-b8d3-0d42543da021 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 217 time: 0.0785301 Nov 15 12:43:46.113355 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4715d4c3-7c5a-44b9-8641-cba2efcf7ddb req-af10f39e-9731-4f3e-8858-1691e810cb38 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.115130 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4715d4c3-7c5a-44b9-8641-cba2efcf7ddb req-af10f39e-9731-4f3e-8858-1691e810cb38 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 943 time: 0.1189549 Nov 15 12:43:46.152459 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event deleted for resources: {'Port': ['ID=9e843abc-71ca-433a-a92b-f035c2503fb4,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:46.155209 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670', '9e843abc-71ca-433a-a92b-f035c2503fb4'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:43:46.294203 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] No DVR routers for this DVR port 9e843abc-71ca-433a-a92b-f035c2503fb4 on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:43:46.302301 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:46.306720 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4715d4c3-7c5a-44b9-8641-cba2efcf7ddb req-abea08ab-be39-4167-8638-e84cea446718 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1576262 Nov 15 12:43:46.309689 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:46.312970 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca4ed0c-5e4f-4828-a913-f3022348d748 req-6c5a4bde-94c7-47c6-952e-12842d53bd52 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.313239 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3f363667-1202-4ac6-b440-620fc12cd167 req-d7abeade-6e11-455b-a27f-d97147dfecfc tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "DELETE /v2.0/ports/9e843abc-71ca-433a-a92b-f035c2503fb4 HTTP/1.1" status: 204 len: 173 time: 0.8936820 Nov 15 12:43:46.315834 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aca4ed0c-5e4f-4828-a913-f3022348d748 req-6c5a4bde-94c7-47c6-952e-12842d53bd52 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.1872344 Nov 15 12:43:46.319269 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-0e848a48-4ba5-40bb-bc1e-7783bc378ccf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.322404 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-0e848a48-4ba5-40bb-bc1e-7783bc378ccf service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.1781571 Nov 15 12:43:46.466472 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-6f5d04e2-da4c-49f5-8acd-bf450470f345 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.468091 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-6f5d04e2-da4c-49f5-8acd-bf450470f345 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1248901 Nov 15 12:43:46.476392 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aca4ed0c-5e4f-4828-a913-f3022348d748 req-725629e5-7540-4c27-b337-b3cfb77253f9 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1156178 Nov 15 12:43:46.516090 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c8723181-0c0f-41f2-833a-5abad5a10dd5 req-cda517de-5424-4ee1-8b0c-c8f5f463d1b9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 210 time: 0.0848472 Nov 15 12:43:46.552996 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e7e580cd-1661-4485-bb46-67ecab8410ac no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:46.579946 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: e7e580cd-1661-4485-bb46-67ecab8410ac {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:43:46.579946 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e7e580cd-1661-4485-bb46-67ecab8410ac not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:43:46.730614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442dc9d3-7ced-4d08-9b2a-a0486c8c811e req-fcea677d-bfbf-451d-b74c-8c4dcfc73840 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:46.732244 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-442dc9d3-7ced-4d08-9b2a-a0486c8c811e req-fcea677d-bfbf-451d-b74c-8c4dcfc73840 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1312678 Nov 15 12:43:46.766649 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-9d602275-46a2-44d4-92b3-9597b965ccb6 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1532743 Nov 15 12:43:46.915080 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-92cec583-f1ca-4f03-bc39-4e60da576736 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-690150005&fields=id&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 267 time: 0.0712855 Nov 15 12:43:46.925055 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-442dc9d3-7ced-4d08-9b2a-a0486c8c811e req-3c89be14-7b6b-412f-a044-b87ca6f88e55 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1568675 Nov 15 12:43:46.957120 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-44b6e498-bf9c-40c0-bdd8-4f9b9d2701df req-5beaac18-47ad-490d-aba7-a7b9bb446eb6 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1640880 Nov 15 12:43:47.001294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'name': 'network-vif-deleted', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:47.003674 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c10e0a9a-7af6-4c14-bd55-01cac9b8bbf4" -d '{"events": [{"server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "name": "network-vif-deleted", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:47.086739 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-34c9f9ae-7a29-4de9-80f7-47145426110f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:47.088971 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-34c9f9ae-7a29-4de9-80f7-47145426110f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.1607366 Nov 15 12:43:47.111545 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-0f0e7e2b-609b-40e6-a6ce-8e2b10837855 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/quotas/ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 375 time: 0.0112731 Nov 15 12:43:47.227913 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-f902f1e2-f1e0-4265-9e17-0003d2baad4e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0975926 Nov 15 12:43:47.379965 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-c3e7c312-f673-48b3-b685-88b8601961f0 service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346979 Nov 15 12:43:47.517598 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b8d19bd-624a-4650-9b4e-b6e6cb92cf98 x-openstack-request-id: req-4b8d19bd-624a-4650-9b4e-b6e6cb92cf98 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:47.518084 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "566a5af7-4e82-4ad6-8e0c-74313a9d900e", "name": "network-vif-deleted", "tag": "9e843abc-71ca-433a-a92b-f035c2503fb4", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:47.518466 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-4b8d19bd-624a-4650-9b4e-b6e6cb92cf98 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:47.519002 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '566a5af7-4e82-4ad6-8e0c-74313a9d900e', 'name': 'network-vif-deleted', 'tag': '9e843abc-71ca-433a-a92b-f035c2503fb4', 'status': 'completed', 'code': 200} Nov 15 12:43:47.521995 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-5c23fc2c-c64d-4829-b5d3-c8b634cea41b service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339965 Nov 15 12:43:47.670462 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1819b46d-7281-4609-be2a-4cf25cb2f3dd req-1398ff01-1134-4e57-8f22-0b0fd7acd210 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:47.674447 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1819b46d-7281-4609-be2a-4cf25cb2f3dd req-1398ff01-1134-4e57-8f22-0b0fd7acd210 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0786726 Nov 15 12:43:47.755300 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1819b46d-7281-4609-be2a-4cf25cb2f3dd req-7c7ac896-904f-4cb6-bfed-e1d15c854b1b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601478 Nov 15 12:43:47.893118 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c98312a-43af-420d-8df7-853101cd816e req-d93b5f73-249f-4868-99fe-60beb35311ed tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:47.894681 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5c98312a-43af-420d-8df7-853101cd816e req-d93b5f73-249f-4868-99fe-60beb35311ed tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 943 time: 0.0720084 Nov 15 12:43:47.983410 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5c98312a-43af-420d-8df7-853101cd816e req-3bdbf584-3421-455e-b258-f7a34cb599de tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794561 Nov 15 12:43:48.100291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-143a4f40-b010-45dd-8f63-7b8338eb4774 req-14f458e0-2097-4fc4-992b-3d51bfaf8d80 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:48.106837 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-143a4f40-b010-45dd-8f63-7b8338eb4774 req-14f458e0-2097-4fc4-992b-3d51bfaf8d80 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.1718249 Nov 15 12:43:48.192801 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c35189fa-d209-4719-b468-1a5471fef918 req-3f00c1e8-e30a-4bee-b73c-39467fd90f64 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=566a5af7-4e82-4ad6-8e0c-74313a9d900e HTTP/1.1" status: 200 len: 210 time: 0.0601728 Nov 15 12:43:48.215167 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-143a4f40-b010-45dd-8f63-7b8338eb4774 req-a91bb3a6-4dc2-40b5-b070-0a632d38178c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956419 Nov 15 12:43:48.287863 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-d132e854-882f-48df-b35d-cef5b850930e req-aa8c6172-399f-4253-a566-29e8e796f747 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:43:48.289003 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d132e854-882f-48df-b35d-cef5b850930e req-aa8c6172-399f-4253-a566-29e8e796f747 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0064068 Nov 15 12:43:48.382236 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 66d80ca0-34c0-4ae9-a96c-a8004410e3af details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:43:48.410369 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9e843abc-71ca-433a-a92b-f035c2503fb4 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:48.461202 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 9e843abc-71ca-433a-a92b-f035c2503fb4 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:43:48.461789 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9e843abc-71ca-433a-a92b-f035c2503fb4 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:43:48.468251 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d01bf4c2-45a5-400b-80f4-8cea8f8948e7 req-52845ba9-b1d9-4cf8-bda3-d6c550c0efe0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.0514791 Nov 15 12:43:48.598559 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:48.611919 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8304374-fb4f-4aaf-969b-b1832c8c9c07 req-2d50effc-14c3-4a43-ad53-800def4c0c73 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:48.614456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'port_id': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'mac_address': 'fa:16:3e:3c:c6:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 601, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:43:48.621834 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b8304374-fb4f-4aaf-969b-b1832c8c9c07 req-2d50effc-14c3-4a43-ad53-800def4c0c73 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0762291 Nov 15 12:43:48.667642 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:48.682146 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66d80ca0-34c0-4ae9-a96c-a8004410e3af {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:43:48.693749 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b8304374-fb4f-4aaf-969b-b1832c8c9c07 req-3e9e6df2-2fc6-493e-9b53-aae839ab13b5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709586 Nov 15 12:43:48.706793 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:48.711061 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:48.770617 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:48.773945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09899e53-0552-473e-8ca8-6caff6e4a014 req-2917d48c-9b0c-4262-a92c-51d8d2c114cc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:48.775590 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-09899e53-0552-473e-8ca8-6caff6e4a014 req-2917d48c-9b0c-4262-a92c-51d8d2c114cc tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0759196 Nov 15 12:43:48.825972 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-09899e53-0552-473e-8ca8-6caff6e4a014 req-03cf3f42-2827-41d8-a3d3-f69d020cab2c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443718 Nov 15 12:43:48.863562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53090) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:43:48.946390 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-bc6fd25d-b2f6-4876-af67-6f49b003e47d service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0816252 Nov 15 12:43:48.955319 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-427be185-5806-43cb-9519-5bf516d94172 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:43:48.956330 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-427be185-5806-43cb-9519-5bf516d94172 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050325 Nov 15 12:43:49.105262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c466f7b-159f-47ee-93fe-c2e1d478d9a4 req-036e65db-6416-4ec9-b623-96054b04aca7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:49.106806 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3c466f7b-159f-47ee-93fe-c2e1d478d9a4 req-036e65db-6416-4ec9-b623-96054b04aca7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 944 time: 0.0501602 Nov 15 12:43:49.162006 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3c466f7b-159f-47ee-93fe-c2e1d478d9a4 req-5875b6fb-d16b-4e53-97ba-7ac0506d3383 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481741 Nov 15 12:43:49.353674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e325a3b-02b0-4779-934e-7dba17f7e0ac req-957659e8-496a-48dd-a32b-fedc73f1d488 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:49.355187 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e325a3b-02b0-4779-934e-7dba17f7e0ac req-957659e8-496a-48dd-a32b-fedc73f1d488 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0619845 Nov 15 12:43:49.403796 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e325a3b-02b0-4779-934e-7dba17f7e0ac req-b031627c-bf7a-4e3a-82f9-e8fa6f1a97d0 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425403 Nov 15 12:43:49.551239 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c11432cc-e065-4d7e-a0b8-baed830143cb req-52736a37-de08-4230-ad66-15887515663a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.0264411 Nov 15 12:43:49.837464 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed11323-35f6-4457-ab47-aca73dfd8615 req-cd08547c-b5c6-4199-a6b4-bbd27bde15fc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:49.838897 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8ed11323-35f6-4457-ab47-aca73dfd8615 req-cd08547c-b5c6-4199-a6b4-bbd27bde15fc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0493865 Nov 15 12:43:49.889258 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8ed11323-35f6-4457-ab47-aca73dfd8615 req-f52831d8-8b19-4ebb-8733-4aa290150f11 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442994 Nov 15 12:43:49.943009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f639ee4-dd9a-4614-aef1-c50311e9e495 req-e12ffaae-041a-44d0-9a86-c40bc51d3a2a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:49.944536 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8f639ee4-dd9a-4614-aef1-c50311e9e495 req-e12ffaae-041a-44d0-9a86-c40bc51d3a2a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0497913 Nov 15 12:43:49.992782 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8f639ee4-dd9a-4614-aef1-c50311e9e495 req-09474213-73a9-49ad-94a0-1b86b2108e45 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421054 Nov 15 12:43:50.282843 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfa8359-4960-46d4-9e51-f4444bcb2ce0 req-a7d23a85-e213-49a2-866e-117dc295ac3a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:50.284356 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3bfa8359-4960-46d4-9e51-f4444bcb2ce0 req-a7d23a85-e213-49a2-866e-117dc295ac3a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 944 time: 0.0526533 Nov 15 12:43:50.332496 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3bfa8359-4960-46d4-9e51-f4444bcb2ce0 req-52e9a911-4ee7-4f08-9ace-441b2a90a7f4 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418832 Nov 15 12:43:50.521348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8911664f-b872-4ba7-8b8b-e907981e7423 req-5c7eda4a-1cd2-4f6f-9b77-68cddccee3cb tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:50.522874 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8911664f-b872-4ba7-8b8b-e907981e7423 req-5c7eda4a-1cd2-4f6f-9b77-68cddccee3cb tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0525229 Nov 15 12:43:50.570887 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8911664f-b872-4ba7-8b8b-e907981e7423 req-375e9266-a503-4011-b76f-ec4309dd7e56 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421078 Nov 15 12:43:50.646254 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1451dd4b-6dfd-41c1-9494-fa320bad5fb6 req-1ab7dd5b-7a3b-4e08-b187-f21293947c6d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.0264575 Nov 15 12:43:51.010861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49f2d14-fe66-4c73-b28f-5e5d4b4b1cea req-3c12fcd6-2412-4440-8f23-42d1026545d9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.012386 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a49f2d14-fe66-4c73-b28f-5e5d4b4b1cea req-3c12fcd6-2412-4440-8f23-42d1026545d9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0498478 Nov 15 12:43:51.064495 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a49f2d14-fe66-4c73-b28f-5e5d4b4b1cea req-0a121ba3-21ea-4e3a-ae6c-d615255058c7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458791 Nov 15 12:43:51.111214 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393295d9-b961-4592-927c-875da45d0048 req-3e921a92-48bc-4294-a3d9-49bcae3700fa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.112716 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-393295d9-b961-4592-927c-875da45d0048 req-3e921a92-48bc-4294-a3d9-49bcae3700fa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0498445 Nov 15 12:43:51.166268 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-393295d9-b961-4592-927c-875da45d0048 req-00ac845b-9683-44d0-bc11-ab4558f682ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474148 Nov 15 12:43:51.346177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-cef8043f-4cb0-4e83-9b21-aa1622ffe294 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.348660 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-cef8043f-4cb0-4e83-9b21-aa1622ffe294 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0690458 Nov 15 12:43:51.406079 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-62926faa-db5a-4a67-a832-3bd3466a67fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.409299 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-62926faa-db5a-4a67-a832-3bd3466a67fd service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=71e17179085148bfacb8d235fc6ee668&device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 1098 time: 0.0757234 Nov 15 12:43:51.543088 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Deleting port 9ee6042d-0234-4720-8aa3-b1782096594e {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:43:51.543494 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:51.589708 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0c4091-1461-414a-8835-c426519f43c4 req-e50efab4-1cd8-4fb1-a4aa-afb45fb07269 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.591394 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8f0c4091-1461-414a-8835-c426519f43c4 req-e50efab4-1cd8-4fb1-a4aa-afb45fb07269 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 944 time: 0.0954242 Nov 15 12:43:51.632888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-3d15723c-e499-4879-9533-e7f8278d7cdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.634455 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-3d15723c-e499-4879-9533-e7f8278d7cdc service neutron] 10.222.0.61 "GET /v2.0/networks?id=4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 200 len: 920 time: 0.2156165 Nov 15 12:43:51.713055 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] For port 9ee6042d-0234-4720-8aa3-b1782096594e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=9ee6042d-0234-4720-8aa3-b1782096594e,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:51.713343 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:51.714883 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-4157f294-13ec-466f-9457-e988cdf76387 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 200 len: 217 time: 0.0695155 Nov 15 12:43:51.730290 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Calling delete_port for 9ee6042d-0234-4720-8aa3-b1782096594e owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:43:51.755569 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665020b4-fdc5-4264-b990-b952b862dcca req-23150d39-4b1f-4e2d-badd-d580d3f1d5bb tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.757304 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-665020b4-fdc5-4264-b990-b952b862dcca req-23150d39-4b1f-4e2d-badd-d580d3f1d5bb tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 945 time: 0.0963378 Nov 15 12:43:51.783140 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8f0c4091-1461-414a-8835-c426519f43c4 req-e2a6ff52-36f1-4eb6-8fa5-2449265b328d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1762676 Nov 15 12:43:51.841012 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-ca9d4562-78f8-47f5-9f3a-7da52e8387ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:51.842982 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-ca9d4562-78f8-47f5-9f3a-7da52e8387ec service neutron] 10.222.0.61 "GET /v2.0/subnets?id=ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 200 len: 859 time: 0.0982561 Nov 15 12:43:51.859918 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:43:51.867080 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-665020b4-fdc5-4264-b990-b952b862dcca req-5773b1b4-cf42-4207-a899-04bfabe97cef tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770383 Nov 15 12:43:51.905764 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-5971d68b-fc62-4272-a773-cf3a69b07f9d service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4a1ca915-de15-4ccc-96e8-10f04d0723e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0501218 Nov 15 12:43:51.942326 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f21932ab-7965-4175-9483-370286253c61 req-82e19698-478e-4a66-806d-b6f7f4752057 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.0399928 Nov 15 12:43:51.968630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:52.007530 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Pushing event deleted for resources: {'Port': ['ID=9ee6042d-0234-4720-8aa3-b1782096594e,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:52.053405 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] No DVR routers for this DVR port 9ee6042d-0234-4720-8aa3-b1782096594e on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:43:52.053875 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-d2ce0be3-ecd8-4e9f-843e-f08cc3ef970e service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1378050 Nov 15 12:43:52.057170 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:52.060651 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-19ced87b-c330-49a1-afc3-649b57cfa9ca req-38401e81-7cad-4b05-96ac-4e3bc558c98b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "DELETE /v2.0/ports/9ee6042d-0234-4720-8aa3-b1782096594e HTTP/1.1" status: 204 len: 173 time: 0.7023528 Nov 15 12:43:52.061149 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'name': 'network-vif-deleted', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:52.064038 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44435efd-1814-45ba-82ce-3c15352d63b5" -d '{"events": [{"server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "name": "network-vif-deleted", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:52.106666 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6338ee7c-947c-4a65-b270-547be67b273b x-openstack-request-id: req-6338ee7c-947c-4a65-b270-547be67b273b {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:52.107132 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "39a4e273-0e9e-4e50-b317-aa4cf2914ca3", "name": "network-vif-deleted", "tag": "9ee6042d-0234-4720-8aa3-b1782096594e", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:52.107547 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6338ee7c-947c-4a65-b270-547be67b273b {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:52.108221 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '39a4e273-0e9e-4e50-b317-aa4cf2914ca3', 'name': 'network-vif-deleted', 'tag': '9ee6042d-0234-4720-8aa3-b1782096594e', 'status': 'completed', 'code': 200} Nov 15 12:43:52.288496 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0182dcea-0455-4f4c-8c9b-32f0895a8df2 req-7703fef8-947d-4a35-b3e2-620a7a500bb0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:52.290321 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0182dcea-0455-4f4c-8c9b-32f0895a8df2 req-7703fef8-947d-4a35-b3e2-620a7a500bb0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1150012 Nov 15 12:43:52.301962 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1b69fbfc-a422-4906-a3c1-31bb212ac9f7 req-287feb71-10f3-4b1e-954c-56ceac7908b6 service neutron] 10.222.0.61 "GET /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2325978 Nov 15 12:43:52.375458 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0182dcea-0455-4f4c-8c9b-32f0895a8df2 req-24363d1c-3760-4b7b-b6a2-61428b8c7707 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606129 Nov 15 12:43:52.432010 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c953c4-ec06-45bd-8489-3234542890f4 req-c3a297c4-90df-46d4-ad9e-4d81d90b8690 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:52.437409 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46c953c4-ec06-45bd-8489-3234542890f4 req-c3a297c4-90df-46d4-ad9e-4d81d90b8690 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1530559 Nov 15 12:43:52.538614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-1aebb748-48a8-4050-a74c-7bc4761f722f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:52.540006 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-1aebb748-48a8-4050-a74c-7bc4761f722f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.2077067 Nov 15 12:43:52.545660 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46c953c4-ec06-45bd-8489-3234542890f4 req-8718066c-6556-4508-9880-ac34022183ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020801 Nov 15 12:43:52.719897 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-1aa8b88b-5b85-451d-9b82-0ded2f7f66cc tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 379 time: 0.1396592 Nov 15 12:43:52.801953 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'port': {'device_id': '49c75c58-0b7e-448b-8179-0af71aebd844', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'admin_state_up': True, 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'security_groups': ['f5f8a6e7-eff7-4cff-a4f3-64559906341e']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:53.028020 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3580acbb-b6bc-4123-b6c4-81f7439347fb req-e9bb1308-658c-4633-8d88-4fb543a094ea tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:53.033874 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3580acbb-b6bc-4123-b6c4-81f7439347fb req-e9bb1308-658c-4633-8d88-4fb543a094ea tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 944 time: 0.1203315 Nov 15 12:43:53.047377 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba32f91-d6ba-4cd3-aeda-83568fab7267 req-a58531a7-e254-4fb6-aa8a-22d58d1ec889 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:53.050014 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0ba32f91-d6ba-4cd3-aeda-83568fab7267 req-a58531a7-e254-4fb6-aa8a-22d58d1ec889 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1525352 Nov 15 12:43:53.130186 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Made reservation on behalf of ad165f3ffe59498e88611526ef4c254d for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:43:53.136571 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:53.145746 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3580acbb-b6bc-4123-b6c4-81f7439347fb req-b9b97704-4715-4672-9261-aa2d9a05c122 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944541 Nov 15 12:43:53.236455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 66d80ca0-34c0-4ae9-a96c-a8004410e3af up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:43:53.266884 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0ba32f91-d6ba-4cd3-aeda-83568fab7267 req-21391b9c-8c03-478c-ac5c-35065d7d37b4 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1982200 Nov 15 12:43:53.437841 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-340045bd-dc22-4eff-bd6d-2e1e71c89c9e req-11e36482-7037-4eaf-b711-6ed463791997 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=39a4e273-0e9e-4e50-b317-aa4cf2914ca3 HTTP/1.1" status: 200 len: 210 time: 0.0823677 Nov 15 12:43:53.444582 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 66d80ca0-34c0-4ae9-a96c-a8004410e3af completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:43:53.467798 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 66d80ca0-34c0-4ae9-a96c-a8004410e3af triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:53.471231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:53.680620 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad58650b-2fa0-4744-b324-71563adb808d req-a4c7f378-12d2-43ac-b020-5d07b414b895 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.2624798 Nov 15 12:43:53.692056 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:53.724582 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.20.0.9 (7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f/2a6efff2-9e7d-4592-b2fe-44911cde042e/d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:43:53.752049 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:43:53.754544 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:53.758599 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d31812a-f972-41ac-89e0-062615d85fcc" -d '{"events": [{"server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "name": "network-vif-plugged", "status": "completed", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:53.764507 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:53.767917 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9ee6042d-0234-4720-8aa3-b1782096594e no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:43:53.810688 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf1bd4f2-3c49-438d-a904-896acb87d5d8 req-b8b190df-f3be-4173-a1b6-c767aa3c1588 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:53.812873 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bf1bd4f2-3c49-438d-a904-896acb87d5d8 req-b8b190df-f3be-4173-a1b6-c767aa3c1588 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.2233486 Nov 15 12:43:53.831466 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 9ee6042d-0234-4720-8aa3-b1782096594e {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:43:53.832146 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 9ee6042d-0234-4720-8aa3-b1782096594e not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:43:53.860996 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:53.915773 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bf1bd4f2-3c49-438d-a904-896acb87d5d8 req-3aaee62a-f92e-4748-9e8c-86fb8f60606b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0914671 Nov 15 12:43:54.026707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f5440e7-0903-4e0b-8ec1-ea7c7cbdb20a x-openstack-request-id: req-7f5440e7-0903-4e0b-8ec1-ea7c7cbdb20a {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:54.027415 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "name": "network-vif-plugged", "status": "completed", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:54.027909 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-7f5440e7-0903-4e0b-8ec1-ea7c7cbdb20a {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:54.028668 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'code': 200} Nov 15 12:43:54.036828 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5cbf92-3774-4aee-9c5e-e42a9110e470 req-513c86a7-71be-4ae0-bff6-a66097b89e65 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.039250 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad5cbf92-3774-4aee-9c5e-e42a9110e470 req-513c86a7-71be-4ae0-bff6-a66097b89e65 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1961629 Nov 15 12:43:54.129039 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:54.174217 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ad5cbf92-3774-4aee-9c5e-e42a9110e470 req-132e3d05-ab90-45a5-b1f0-1600a30585aa tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200304 Nov 15 12:43:54.272186 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-009bf9f1-d014-446f-9009-b64e69353efc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.275815 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:54.279498 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-009bf9f1-d014-446f-9009-b64e69353efc service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 1096 time: 0.1473756 Nov 15 12:43:54.564545 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675b4f6d-9c6c-4e33-9ce9-3e1404152b3d req-795c5322-c7e1-405b-a85c-3f5d2e7c645e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.572426 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:43:54.574377 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-675b4f6d-9c6c-4e33-9ce9-3e1404152b3d req-795c5322-c7e1-405b-a85c-3f5d2e7c645e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.2581811 Nov 15 12:43:54.589100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:43:54.607458 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:54.611719 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:43:54.647010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-cf915baa-c451-4282-a902-25cd845f418b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.648994 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-cf915baa-c451-4282-a902-25cd845f418b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1096 time: 0.2864039 Nov 15 12:43:54.703339 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-675b4f6d-9c6c-4e33-9ce9-3e1404152b3d req-747de6f7-61ef-43e0-8384-22e3ae85b22b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276977 Nov 15 12:43:54.716396 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.717599 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:54.726640 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b373cdf7-4971-4356-a4be-077d35d0f730 req-7905cd0b-6ed9-4fdc-9b3e-d9c25ff0e14e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.731508 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b373cdf7-4971-4356-a4be-077d35d0f730 req-7905cd0b-6ed9-4fdc-9b3e-d9c25ff0e14e service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1098 time: 0.3343923 Nov 15 12:43:54.773510 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ca80dd-abfd-43cf-8ffd-61b1d1f21ab0 req-94e83889-0c63-4100-a7c9-abeaea754848 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:54.781561 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-04ca80dd-abfd-43cf-8ffd-61b1d1f21ab0 req-94e83889-0c63-4100-a7c9-abeaea754848 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.2535155 Nov 15 12:43:54.795917 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ab8be4cd-443a-4fcd-9b3b-14f7a2570e39 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0048966 Nov 15 12:43:54.851427 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Request body: {'port': {'device_id': '49c75c58-0b7e-448b-8179-0af71aebd844', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:43:54.957034 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-04ca80dd-abfd-43cf-8ffd-61b1d1f21ab0 req-72196ca5-ca02-4886-82bc-a98486d091b6 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1742320 Nov 15 12:43:55.018590 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b373cdf7-4971-4356-a4be-077d35d0f730 req-3cdbacd8-30ba-426f-bb4d-62e40d1dd39b service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2676904 Nov 15 12:43:55.028063 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-db35ec0b-a3a1-4d37-bc48-6aee83076d32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:55.030259 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-db35ec0b-a3a1-4d37-bc48-6aee83076d32 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.3480723 Nov 15 12:43:55.039561 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:55.072540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924f45d7-f780-4e25-acbf-59820ca00d07 req-d09beebd-594d-4156-9f96-aa26b1402a91 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:55.074966 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-924f45d7-f780-4e25-acbf-59820ca00d07 req-d09beebd-594d-4156-9f96-aa26b1402a91 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 931 time: 0.1048119 Nov 15 12:43:55.171914 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-df2c5927-d287-46e3-a758-f62b5c71f9f2 None None] Provisioning complete for port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:43:55.173735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-df2c5927-d287-46e3-a758-f62b5c71f9f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:55.215019 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-924f45d7-f780-4e25-acbf-59820ca00d07 req-6117c21b-c541-45bd-9d52-5c0e67c62c29 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1309929 Nov 15 12:43:55.249713 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-df2c5927-d287-46e3-a758-f62b5c71f9f2 None None] Port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:43:55.402167 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac14a13e-2e78-4231-8482-34b1cf08af19 req-9751c29e-3526-4c41-a597-d0328116e9ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:55.406365 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ac14a13e-2e78-4231-8482-34b1cf08af19 req-9751c29e-3526-4c41-a597-d0328116e9ae tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0912592 Nov 15 12:43:55.613174 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eab3fec-b07b-4492-823d-36f0a5e086c5 req-61badbc6-c3c4-43bc-a7a9-d51fd54b538c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:55.614940 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6eab3fec-b07b-4492-823d-36f0a5e086c5 req-61badbc6-c3c4-43bc-a7a9-d51fd54b538c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.4801033 Nov 15 12:43:55.660168 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ac14a13e-2e78-4231-8482-34b1cf08af19 req-b1d2c6a7-777d-4d55-97c8-e91420144a2a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2322893 Nov 15 12:43:55.671089 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-5063e8c6-3860-473f-9b46-82a29b04cf8d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 999 time: 0.2125790 Nov 15 12:43:55.774842 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6eab3fec-b07b-4492-823d-36f0a5e086c5 req-4645ce6c-dba8-4f46-87d5-83c5a5958cdb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1418746 Nov 15 12:43:55.889290 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb62c36-00dc-4dab-a569-ad8761de3630 req-a5bc27f1-5b5b-4990-b969-750c62e70062 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:55.903104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ccb62c36-00dc-4dab-a569-ad8761de3630 req-a5bc27f1-5b5b-4990-b969-750c62e70062 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0724945 Nov 15 12:43:55.904488 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:43:55.914544 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:55.928997 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Transition to ACTIVE for port object d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:43:55.935465 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:55.995923 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ccb62c36-00dc-4dab-a569-ad8761de3630 req-7902df49-cc55-4431-a292-c5c5eed190c6 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909557 Nov 15 12:43:56.015502 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Pushing event updated for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:56.091948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Attempting to bind port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:43:56.092471 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Attempting to bind port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:43:56.092899 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Attempting to bind port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:56.109554 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:43:56.110080 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Attempting to bind port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:43:56.147201 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 43, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:43:56.147829 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:43:56.148634 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Bound using segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:43:56.149550 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Bound port: d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:43:56.150247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:56.193589 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afdfac2-5375-4d26-bf71-71e0ed622f72 req-bf0633d5-2d93-49c1-8488-d572c2d98ac8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:56.195556 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1afdfac2-5375-4d26-bf71-71e0ed622f72 req-bf0633d5-2d93-49c1-8488-d572c2d98ac8 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1000504 Nov 15 12:43:56.300392 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1afdfac2-5375-4d26-bf71-71e0ed622f72 req-ca854d43-57b6-4ea9-9136-cea5570c0f79 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923853 Nov 15 12:43:56.314457 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:43:56.320041 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:43:56.327113 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:56.406182 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:56.407636 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:43:56.409491 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] 10.222.0.61 "PUT /v2.0/ports/d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 HTTP/1.1" status: 200 len: 1093 time: 1.5759964 Nov 15 12:43:56.420584 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:43:56.425555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0ce58c1-9814-48a0-99dc-98bd52cd0579" -d '{"events": [{"name": "network-changed", "server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:43:56.443624 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7a7e1b-1d23-4c02-aa3f-47b692354d88 req-0ecb10cf-d6ec-49ea-850b-22903e6488f5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:56.449864 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fb7a7e1b-1d23-4c02-aa3f-47b692354d88 req-0ecb10cf-d6ec-49ea-850b-22903e6488f5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0977411 Nov 15 12:43:56.481754 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed1c72d8-4052-4e04-b2dc-4aa2498a1c3b service neutron] Pushing event updated for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:43:56.503935 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:43:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1bacf01-0c90-45a9-880c-68ae2ccc23dd x-openstack-request-id: req-e1bacf01-0c90-45a9-880c-68ae2ccc23dd {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:43:56.504259 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:43:56.504503 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-e1bacf01-0c90-45a9-880c-68ae2ccc23dd {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:43:56.504905 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'status': 'completed', 'code': 200} Nov 15 12:43:56.533698 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fb7a7e1b-1d23-4c02-aa3f-47b692354d88 req-a7e9aac4-3a2a-46c9-aad1-8e107e122740 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0740991 Nov 15 12:43:56.917957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e9de53-07a9-42b7-8057-1a1eeb7aca00 req-e0639fa5-331c-471b-8f33-74409ebaf2c7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:56.920401 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-25e9de53-07a9-42b7-8057-1a1eeb7aca00 req-e0639fa5-331c-471b-8f33-74409ebaf2c7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0866010 Nov 15 12:43:56.945501 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6c99d7-0374-4fe4-9d36-bbbf01ea7dfe req-133e9e36-9aae-49d6-9a97-dc3c318fb9e9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:56.948145 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec6c99d7-0374-4fe4-9d36-bbbf01ea7dfe req-133e9e36-9aae-49d6-9a97-dc3c318fb9e9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0797877 Nov 15 12:43:56.989660 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-25e9de53-07a9-42b7-8057-1a1eeb7aca00 req-3e215559-6674-4be2-9936-885b4b2924c6 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628259 Nov 15 12:43:57.058430 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec6c99d7-0374-4fe4-9d36-bbbf01ea7dfe req-df6c589a-50af-420c-a754-25bc974ed895 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1021211 Nov 15 12:43:57.185002 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c61876-1f1e-4094-807f-7a8d33cb5fb4 req-62aa8c43-d369-4b26-b7e5-3665c7604c81 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:57.186585 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82c61876-1f1e-4094-807f-7a8d33cb5fb4 req-62aa8c43-d369-4b26-b7e5-3665c7604c81 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0721650 Nov 15 12:43:57.281188 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82c61876-1f1e-4094-807f-7a8d33cb5fb4 req-9df25838-9a49-4d7e-89fe-4e65e7285469 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789981 Nov 15 12:43:57.503205 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f03aec-3c39-466b-bbac-5afbc8318389 req-aef59dbd-a4de-4094-84f7-e693576ff6f0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:57.506316 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d6f03aec-3c39-466b-bbac-5afbc8318389 req-aef59dbd-a4de-4094-84f7-e693576ff6f0 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.0749803 Nov 15 12:43:57.568740 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d6f03aec-3c39-466b-bbac-5afbc8318389 req-00a3266d-f704-4811-847b-4b667f8a73c1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566347 Nov 15 12:43:57.705399 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6efbb8a3-195d-45f8-8052-667a8c67472f req-72adf249-9e10-4788-802c-ff4b54366056 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:57.708937 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6efbb8a3-195d-45f8-8052-667a8c67472f req-72adf249-9e10-4788-802c-ff4b54366056 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0838099 Nov 15 12:43:57.800844 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6efbb8a3-195d-45f8-8052-667a8c67472f req-a6502294-b9fe-457e-94e4-26ca52bc2aa5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0834672 Nov 15 12:43:58.150891 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2c8255-6386-49bd-81dc-cbfd6ab393ba req-c4d28136-c8a4-4eea-b990-ccd6980b9db0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:58.153052 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0c2c8255-6386-49bd-81dc-cbfd6ab393ba req-c4d28136-c8a4-4eea-b990-ccd6980b9db0 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0836179 Nov 15 12:43:58.242375 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0c2c8255-6386-49bd-81dc-cbfd6ab393ba req-acb0d713-eb4c-4857-9043-9398982e807a tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797210 Nov 15 12:43:58.267006 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ff287d-650f-4a57-864b-302128851474 req-6be40801-6e9e-40c0-82eb-db31e7ba7586 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:58.269677 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e7ff287d-650f-4a57-864b-302128851474 req-6be40801-6e9e-40c0-82eb-db31e7ba7586 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0906420 Nov 15 12:43:58.398634 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e7ff287d-650f-4a57-864b-302128851474 req-5d6e64d8-8a2b-484e-a636-7a0c14329acc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1163085 Nov 15 12:43:58.451499 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8480cda-c98a-4b3e-a1fd-bd3c48f876d6 req-94eeecf5-f05e-46c7-8548-8cc60fd182af tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:58.453571 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b8480cda-c98a-4b3e-a1fd-bd3c48f876d6 req-94eeecf5-f05e-46c7-8548-8cc60fd182af tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0626309 Nov 15 12:43:58.535084 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b8480cda-c98a-4b3e-a1fd-bd3c48f876d6 req-af6bfe52-3c35-44c1-bdae-8735525960d9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733507 Nov 15 12:43:58.706539 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ddc8dc4-ba4d-49ca-a387-4a5eb16f88ce req-1acd8610-ee24-4a89-834d-006bc949f1fb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:58.713897 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4ddc8dc4-ba4d-49ca-a387-4a5eb16f88ce req-1acd8610-ee24-4a89-834d-006bc949f1fb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.0653212 Nov 15 12:43:58.756943 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:43:58.765335 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4ddc8dc4-ba4d-49ca-a387-4a5eb16f88ce req-f46c8f67-51f0-4051-be15-e8b6be512e8c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504987 Nov 15 12:43:58.939374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f49991-c37c-438b-ad45-ac0a8a696a8f req-73cd5db3-361d-491e-a03f-a6e8caec91df tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:58.940955 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-83f49991-c37c-438b-ad45-ac0a8a696a8f req-73cd5db3-361d-491e-a03f-a6e8caec91df tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0614333 Nov 15 12:43:59.012035 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-83f49991-c37c-438b-ad45-ac0a8a696a8f req-47650249-8cfd-4a47-89a4-af44e5044527 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0623786 Nov 15 12:43:59.390947 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-2f5e134c-a462-49fc-aaa0-e762d961698d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.393156 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-2f5e134c-a462-49fc-aaa0-e762d961698d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.1739848 Nov 15 12:43:59.406433 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-e2c04f8b-9285-489e-933b-a9a8813af1be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.408529 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-e2c04f8b-9285-489e-933b-a9a8813af1be service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1096 time: 0.1662426 Nov 15 12:43:59.501747 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952ebfcd-0625-4b8c-b9d1-1d50d32f6c91 req-e6a35aa9-f9a3-471d-97ce-40b28ff7ad0e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.505104 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-952ebfcd-0625-4b8c-b9d1-1d50d32f6c91 req-e6a35aa9-f9a3-471d-97ce-40b28ff7ad0e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1228778 Nov 15 12:43:59.578237 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-d89a2358-b68d-4077-bf2e-9b21e7045276 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.582399 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-d89a2358-b68d-4077-bf2e-9b21e7045276 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1711338 Nov 15 12:43:59.713953 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-ae343499-9f22-4eae-aac2-2507b3709089 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.718472 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-ae343499-9f22-4eae-aac2-2507b3709089 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=ad165f3ffe59498e88611526ef4c254d&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2353218 Nov 15 12:43:59.756920 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d76ad61-abf4-4ff5-afbf-9e6b76a7a06f req-b9b28392-f718-438a-a4ab-c5986ce02879 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.765269 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d76ad61-abf4-4ff5-afbf-9e6b76a7a06f req-b9b28392-f718-438a-a4ab-c5986ce02879 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.2422779 Nov 15 12:43:59.781778 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-952ebfcd-0625-4b8c-b9d1-1d50d32f6c91 req-b6943b9c-f60e-4b7a-b3d7-c8b6cecabaa3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2548890 Nov 15 12:43:59.857565 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-36a9b8c5-d12c-417f-81d8-71bcafc70e65 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2542787 Nov 15 12:43:59.925222 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-9b0f5135-d7b3-476e-b8fc-ef004aaa1008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:43:59.928449 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a0ce58c1-9814-48a0-99dc-98bd52cd0579 req-9b0f5135-d7b3-476e-b8fc-ef004aaa1008 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1281133 Nov 15 12:44:00.054828 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848c1a09-a901-4e18-9469-cb5a2aaacf8d req-0a534ede-b310-424e-b8c5-adb61b1952d7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.057908 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-848c1a09-a901-4e18-9469-cb5a2aaacf8d req-0a534ede-b310-424e-b8c5-adb61b1952d7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.1287439 Nov 15 12:44:00.111915 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d76ad61-abf4-4ff5-afbf-9e6b76a7a06f req-cf3dfb07-2279-4b79-8d58-bef1b7aa97dc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3437829 Nov 15 12:44:00.121176 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-0a216081-c58d-4b47-946c-43e011df2f26 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2521291 Nov 15 12:44:00.189373 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ee1b4a43-71bd-4998-9774-f15a568d295b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.191936 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ee1b4a43-71bd-4998-9774-f15a568d295b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1096 time: 0.1323121 Nov 15 12:44:00.241526 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-848c1a09-a901-4e18-9469-cb5a2aaacf8d req-48ae7215-fe79-415f-8a85-4fec8c48e59c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1649983 Nov 15 12:44:00.338239 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-ed9e7fdd-9c38-46c2-b3d5-e47b0c5c2382 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 HTTP/1.1" status: 200 len: 217 time: 0.0953481 Nov 15 12:44:00.340468 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-1055b1b7-d3b9-449a-a383-901ae78c4a9c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.341738 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-1055b1b7-d3b9-449a-a383-901ae78c4a9c tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1090624 Nov 15 12:44:00.364719 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec47c5e2-c78b-4abd-8179-afe6072a7f15 req-e4680b79-0203-47a0-b01e-838852ceef96 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.366384 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec47c5e2-c78b-4abd-8179-afe6072a7f15 req-e4680b79-0203-47a0-b01e-838852ceef96 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 946 time: 0.1204994 Nov 15 12:44:00.464026 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058b49dc-4dfe-40d7-ad95-5f117bf3bd3c req-ecfc12d6-82b8-48d7-a270-5bd917d70c4e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.466672 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-058b49dc-4dfe-40d7-ad95-5f117bf3bd3c req-ecfc12d6-82b8-48d7-a270-5bd917d70c4e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0895607 Nov 15 12:44:00.495941 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec47c5e2-c78b-4abd-8179-afe6072a7f15 req-17419d89-34f4-48b7-a0a8-2069c4750fd9 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/security-groups?id=6074f50c-78c6-4931-a525-0e6079898dec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088767 Nov 15 12:44:00.608973 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-4f2c32b7-d7b8-4ce4-9141-ae5050581d87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.612669 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-4f2c32b7-d7b8-4ce4-9141-ae5050581d87 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0913129 Nov 15 12:44:00.685678 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-058b49dc-4dfe-40d7-ad95-5f117bf3bd3c req-0392699d-fd3a-47fd-9317-60b823c5709e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2117116 Nov 15 12:44:00.754870 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Deleting port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:44:00.755388 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:00.769749 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-bb568cd5-a197-4768-a623-a8e7169b82d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:00.773232 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-bb568cd5-a197-4768-a623-a8e7169b82d1 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0861650 Nov 15 12:44:01.009304 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-fd18fc1d-e710-4c81-970b-9e741b222de7 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2116737 Nov 15 12:44:01.047198 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] For port 1bf5cf4f-25e6-407d-8d56-f33732c6f670, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=1bf5cf4f-25e6-407d-8d56-f33732c6f670,segment=NetworkSegment(d9fc4f19-bcef-4f65-b755-b74ba49c22d2),segment_id=d9fc4f19-bcef-4f65-b755-b74ba49c22d2)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:01.048692 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:01.073369 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Calling delete_port for 1bf5cf4f-25e6-407d-8d56-f33732c6f670 owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:44:01.102820 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f311d73-65c8-415c-a77d-ffa8dc0afd90 req-5f6327bc-95d8-4eac-8554-f1c78b91e667 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:01.105241 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9f311d73-65c8-415c-a77d-ffa8dc0afd90 req-5f6327bc-95d8-4eac-8554-f1c78b91e667 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1182084 Nov 15 12:44:01.225382 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cc2d75b3-26ec-4ce7-b778-92813cf4a032 req-bb03ea57-66f1-4771-8099-24ac41b2abd2 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2022154 Nov 15 12:44:01.303665 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9f311d73-65c8-415c-a77d-ffa8dc0afd90 req-31f9dc10-c76c-4189-b0a6-16d8f07d0555 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074264 Nov 15 12:44:01.428278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8875ed2d-f8ac-418e-b511-980f38626dca req-3f263324-cc51-4122-8cc3-018a6eeed9e4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:01.444954 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8875ed2d-f8ac-418e-b511-980f38626dca req-3f263324-cc51-4122-8cc3-018a6eeed9e4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1782835 Nov 15 12:44:01.588419 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8875ed2d-f8ac-418e-b511-980f38626dca req-f3d16ca0-745a-4dab-ac69-1f4be3df874c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1253691 Nov 15 12:44:01.606780 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:01.670543 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['1bf5cf4f-25e6-407d-8d56-f33732c6f670'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:01.677348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Pushing event deleted for resources: {'Port': ['ID=1bf5cf4f-25e6-407d-8d56-f33732c6f670,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:01.787764 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] No DVR routers for this DVR port 1bf5cf4f-25e6-407d-8d56-f33732c6f670 on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:44:01.795729 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:01.812876 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2581a51-d64e-44e7-95cb-c1eedf6c46c6 req-502d0f28-befa-4de2-a42e-a555d5f54406 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.61 "DELETE /v2.0/ports/1bf5cf4f-25e6-407d-8d56-f33732c6f670 HTTP/1.1" status: 204 len: 173 time: 1.3094697 Nov 15 12:44:01.814313 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'name': 'network-vif-deleted', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:01.816841 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a8b69c9-c4d5-4cca-b0ae-5c1b353a2f96" -d '{"events": [{"server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "name": "network-vif-deleted", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:01.838223 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-69559664-8877-4079-889f-728b7d05741a req-f1dc3f2c-a4e8-4e30-b3b9-6b6865ee4cdb tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0360157 Nov 15 12:44:01.856008 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c888fa3-d193-40c8-93a1-eba5d5bbbe78 req-a13df735-b917-4c08-95ae-61f309bff5f4 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:01.864964 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6c888fa3-d193-40c8-93a1-eba5d5bbbe78 req-a13df735-b917-4c08-95ae-61f309bff5f4 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.2693467 Nov 15 12:44:01.950050 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6c888fa3-d193-40c8-93a1-eba5d5bbbe78 req-473cbab9-8dd4-4115-870b-b250751970c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841866 Nov 15 12:44:02.499798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7605c88b-092d-482a-b935-22c238d4d4e7 req-cd539e5c-fda9-4903-ab3a-c7a80179267c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:02.509241 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7605c88b-092d-482a-b935-22c238d4d4e7 req-cd539e5c-fda9-4903-ab3a-c7a80179267c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.2978783 Nov 15 12:44:02.570460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ff1a12b-ecf2-4831-a414-bdde7795c6d8 x-openstack-request-id: req-7ff1a12b-ecf2-4831-a414-bdde7795c6d8 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:02.570844 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "133b2150-d5cc-45fc-9ba3-59c17b9f67c1", "name": "network-vif-deleted", "tag": "1bf5cf4f-25e6-407d-8d56-f33732c6f670", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:02.572465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-7ff1a12b-ecf2-4831-a414-bdde7795c6d8 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:02.573545 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '133b2150-d5cc-45fc-9ba3-59c17b9f67c1', 'name': 'network-vif-deleted', 'tag': '1bf5cf4f-25e6-407d-8d56-f33732c6f670', 'status': 'completed', 'code': 200} Nov 15 12:44:02.683805 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7605c88b-092d-482a-b935-22c238d4d4e7 req-57ee06c3-11b4-477b-bcbe-94c5131711fa tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1611860 Nov 15 12:44:02.901635 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c669c1f3-9c4d-4bad-bae8-b1a1e85b92c6 req-d29834f7-f8f5-48d7-8cec-58adeaa68c27 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:02.920859 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c669c1f3-9c4d-4bad-bae8-b1a1e85b92c6 req-d29834f7-f8f5-48d7-8cec-58adeaa68c27 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.1357543 Nov 15 12:44:02.931171 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7746ca6a-d830-4ec8-902c-3dadffaea6f8 req-8b212f9a-c2ef-4da6-9a58-de762312ff4d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:02.933515 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7746ca6a-d830-4ec8-902c-3dadffaea6f8 req-8b212f9a-c2ef-4da6-9a58-de762312ff4d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0933011 Nov 15 12:44:03.017423 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c669c1f3-9c4d-4bad-bae8-b1a1e85b92c6 req-97125a13-1e0a-40c8-9569-6df24c012045 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925698 Nov 15 12:44:03.066845 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7746ca6a-d830-4ec8-902c-3dadffaea6f8 req-bbb2e8d7-7af5-4d3f-a6cb-8a644cd969dd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1246798 Nov 15 12:44:03.275557 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7e7406cf-8b74-49c3-8826-a17ed54b77c9 req-34b057e3-ff79-407c-b144-84cfc5a9cdd7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0964968 Nov 15 12:44:03.350510 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-47374dbf-16c2-40f9-ba48-912eacadabbf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:03.825915 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a62524b-36b5-4613-97f3-09fa21c6e668 req-2a98d087-e0f6-46f8-9023-7ae1558d5a93 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:03.836985 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1a62524b-36b5-4613-97f3-09fa21c6e668 req-2a98d087-e0f6-46f8-9023-7ae1558d5a93 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.1287370 Nov 15 12:44:03.901046 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec806e15-5cbc-4fd3-a0b9-acdbe4675d70 req-c3478931-e58d-4835-8513-474a03e0e2b8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:03.912272 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec806e15-5cbc-4fd3-a0b9-acdbe4675d70 req-c3478931-e58d-4835-8513-474a03e0e2b8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0835612 Nov 15 12:44:03.948594 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1a62524b-36b5-4613-97f3-09fa21c6e668 req-67f8fd6e-b063-4995-be4e-4632a8f2f6b5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1099861 Nov 15 12:44:04.012631 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ec806e15-5cbc-4fd3-a0b9-acdbe4675d70 req-9183a91b-cb13-4712-9d03-0c0c99b814fb tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0956471 Nov 15 12:44:04.306464 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91eedd49-c56e-46a4-86ca-fc471c5466ca req-e7c42e76-5684-4a95-acfa-fe0ff65d16b3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:04.309494 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91eedd49-c56e-46a4-86ca-fc471c5466ca req-e7c42e76-5684-4a95-acfa-fe0ff65d16b3 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0886114 Nov 15 12:44:04.408218 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-91eedd49-c56e-46a4-86ca-fc471c5466ca req-b9b90d4d-ff44-4be2-8946-6411e73461a1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0899749 Nov 15 12:44:04.502433 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-707ab772-3bd0-47ad-afa9-a6043441ea25 req-c9e0797d-b814-40c2-9514-5d1976e57ce1 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0421951 Nov 15 12:44:05.132987 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5acdec-60cb-4f92-9f19-6fb5247d5025 req-b8079df0-b67d-494b-87db-39568f0d2a2d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:05.134502 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef5acdec-60cb-4f92-9f19-6fb5247d5025 req-b8079df0-b67d-494b-87db-39568f0d2a2d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0591495 Nov 15 12:44:05.184842 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef5acdec-60cb-4f92-9f19-6fb5247d5025 req-ecaa6e5b-9387-4352-8cb4-4598f62e9aa7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444131 Nov 15 12:44:05.450394 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 1bf5cf4f-25e6-407d-8d56-f33732c6f670 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:44:05.483644 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 1bf5cf4f-25e6-407d-8d56-f33732c6f670 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:44:05.484242 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 1bf5cf4f-25e6-407d-8d56-f33732c6f670 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:44:05.568221 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67f2e15-875e-4375-b52c-9f9cb2d66297 req-3c373e6c-bae7-420c-9562-2870b10a5e33 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:05.569742 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f67f2e15-875e-4375-b52c-9f9cb2d66297 req-3c373e6c-bae7-420c-9562-2870b10a5e33 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0571895 Nov 15 12:44:05.620745 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f67f2e15-875e-4375-b52c-9f9cb2d66297 req-692e9cb3-934f-43b7-b3e5-295d1da8d461 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427401 Nov 15 12:44:05.651629 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d041b0c0-3f7f-4977-b4fc-55846d84641a req-98ecfa45-abdb-4a52-b649-23167d1c1072 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0414343 Nov 15 12:44:05.755437 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a781949d-faeb-4706-9fe2-a4f5b69b6d51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:06.301306 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0ef83f-2911-4b60-9e53-d60316fa3c3b req-1662598d-de9c-4aa3-a29d-f3dfd224729d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:06.302791 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7f0ef83f-2911-4b60-9e53-d60316fa3c3b req-1662598d-de9c-4aa3-a29d-f3dfd224729d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0490642 Nov 15 12:44:06.352848 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7f0ef83f-2911-4b60-9e53-d60316fa3c3b req-a333308c-d211-43f1-9aa0-40c8997dd001 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441260 Nov 15 12:44:06.886752 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:06.892367 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4985a2d7-9700-428e-b25e-6793fcfe1413 req-bb91a30d-753d-4185-9d83-319de2a0cd22 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:06.893793 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cc1582ea-1a43-4bd3-ab07-2fc377f157a3 req-2e9a1355-c604-4d61-8870-b20ee4a53199 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0445282 Nov 15 12:44:06.895367 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4985a2d7-9700-428e-b25e-6793fcfe1413 req-bb91a30d-753d-4185-9d83-319de2a0cd22 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1624594 Nov 15 12:44:07.006061 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4985a2d7-9700-428e-b25e-6793fcfe1413 req-5b090751-382f-4feb-ba09-dff583a792f9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0925543 Nov 15 12:44:07.682320 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74756f5-cd4e-48e1-9b30-09b3d4a110a1 req-d21d913e-940e-4e69-ad7c-cecfcd5e6821 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:07.684300 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a74756f5-cd4e-48e1-9b30-09b3d4a110a1 req-d21d913e-940e-4e69-ad7c-cecfcd5e6821 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0926290 Nov 15 12:44:07.776948 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a74756f5-cd4e-48e1-9b30-09b3d4a110a1 req-49f5b257-9558-454f-8f76-fa13e5b4b8f6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0860934 Nov 15 12:44:08.189169 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8afacbcc-371a-4326-b55c-d35eff16565a req-0d5461a0-bee6-4874-be78-9e3e6a11627a tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0676329 Nov 15 12:44:08.339348 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:08.404086 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10d2831-0af6-43a6-93d6-4bae4fc69d3e req-76d5b1ad-1735-4b53-ad94-ea7af540f05f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:08.406659 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f10d2831-0af6-43a6-93d6-4bae4fc69d3e req-76d5b1ad-1735-4b53-ad94-ea7af540f05f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1181819 Nov 15 12:44:08.493520 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f10d2831-0af6-43a6-93d6-4bae4fc69d3e req-e3e1d934-7a3f-4e2a-b30c-863e6c9f3a42 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0783074 Nov 15 12:44:09.136941 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:14.080641 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:17.462401 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-a462b9ce-e39a-4627-8547-9092eafe768c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:17.464147 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-a462b9ce-e39a-4627-8547-9092eafe768c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 814 time: 0.4232330 Nov 15 12:44:17.491119 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-4e13c07a-6dd9-476f-8b33-3034e9df5025 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/quotas/171ad5c938bc4bcebdf3addd4a1692dc HTTP/1.1" status: 200 len: 375 time: 0.0159736 Nov 15 12:44:17.540879 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-aa82497c-fc25-4706-8b68-45d0cc7be5c1 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0384965 Nov 15 12:44:17.648815 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-58d7df13-36a2-4651-8377-cee35d4c03ac service neutron] 10.222.0.44 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973730 Nov 15 12:44:17.768096 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-c80bb73c-a0e2-4825-878a-53f9203c0817 service neutron] 10.222.0.44 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1107562 Nov 15 12:44:18.108707 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8830ef67-78c7-4dec-8f2c-bcc56ed9b8d7 req-61d2d4bb-0902-4658-873e-aba50277a059 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:18.111694 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8830ef67-78c7-4dec-8f2c-bcc56ed9b8d7 req-61d2d4bb-0902-4658-873e-aba50277a059 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0963128 Nov 15 12:44:18.184453 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8830ef67-78c7-4dec-8f2c-bcc56ed9b8d7 req-fab0e4f4-fd83-4201-a7a4-456e4e9336b5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0657721 Nov 15 12:44:18.356857 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-110bfd9a-4fd5-43c3-b93a-afd6a8b44d99 req-b722d103-f0d3-439e-8a74-1a0a04d8bb1f tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0422468 Nov 15 12:44:18.580407 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a33171-dc31-4647-af1f-4f7d9e9727cf req-70223a92-1985-4c0e-97d4-26b055ced3eb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:18.585198 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b5a33171-dc31-4647-af1f-4f7d9e9727cf req-70223a92-1985-4c0e-97d4-26b055ced3eb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0626366 Nov 15 12:44:18.684839 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b5a33171-dc31-4647-af1f-4f7d9e9727cf req-44192a7f-2180-480b-965a-f5fc6b2b12c7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0884731 Nov 15 12:44:18.793209 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cb7cd073-4675-4d1a-a39f-378e7d5467ec req-1a2ec07c-cebf-4fb6-be8d-77325ab22297 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0381789 Nov 15 12:44:19.397738 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df4b25e-ab14-459f-96f6-3c8c7197c973 req-2f28b815-2791-4c90-9930-322dd1fefd1f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:19.399193 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8df4b25e-ab14-459f-96f6-3c8c7197c973 req-2f28b815-2791-4c90-9930-322dd1fefd1f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0806928 Nov 15 12:44:19.466319 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8df4b25e-ab14-459f-96f6-3c8c7197c973 req-90fa51ab-c07b-487b-bc4d-95d3fa593347 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524075 Nov 15 12:44:19.583417 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-171cc354-4139-43e1-8adc-263727011a93 req-72fb08cd-0c79-45ca-b58a-f31042d43a6d tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0368853 Nov 15 12:44:19.827718 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f516bf-9b05-4e52-bb74-56c7cc17cc37 req-8617dadd-b8ee-4982-bd40-323d59944e57 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:19.829787 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-93f516bf-9b05-4e52-bb74-56c7cc17cc37 req-8617dadd-b8ee-4982-bd40-323d59944e57 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0575051 Nov 15 12:44:19.906279 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-93f516bf-9b05-4e52-bb74-56c7cc17cc37 req-50960661-acad-446d-982a-07cf884a5545 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0703013 Nov 15 12:44:20.002615 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ce2def60-4be8-43f2-b634-704718ef0e6c req-03f90f5a-1010-45a9-b0a3-350c5f936d49 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0298512 Nov 15 12:44:20.145002 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53560) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:20.214841 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Deleting subnet 9c262ff8-39d2-4560-8a17-db7d1bd0eb4f {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:44:20.218285 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.266866 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.326818 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.394669 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.411690 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.415322 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] 10.222.0.44 "DELETE /v2.0/subnets/9c262ff8-39d2-4560-8a17-db7d1bd0eb4f HTTP/1.1" status: 204 len: 168 time: 0.2679753 Nov 15 12:44:20.419117 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 53562) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:20.433917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac4d5c4-f406-43c7-b954-f9894a0839cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9c262ff8-39d2-4560-8a17-db7d1bd0eb4f,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:20.490038 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.636823 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.665564 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29de8c58-f293-40d7-a944-86383e773ce7']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:20.684106 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d772081a-a239-414a-96fb-4df759d3fdf2 req-eed36d52-6b4f-45f3-877b-3e55f0290f9c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:20.685670 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d772081a-a239-414a-96fb-4df759d3fdf2 req-eed36d52-6b4f-45f3-877b-3e55f0290f9c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.1169620 Nov 15 12:44:20.687649 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75c34c2d-db36-477f-b460-e981d9675cdd') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:20.688528 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75c34c2d-db36-477f-b460-e981d9675cdd') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:20.704516 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.726323 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.739382 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Releasing vlan 646 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:44:20.739763 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:44:20.741419 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:44:20.802372 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d772081a-a239-414a-96fb-4df759d3fdf2 req-4fd40b28-afb6-441f-beab-e03c827b1493 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1068270 Nov 15 12:44:20.830186 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.845147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:20.855960 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] 10.222.0.44 "DELETE /v2.0/networks/29de8c58-f293-40d7-a944-86383e773ce7 HTTP/1.1" status: 204 len: 168 time: 0.4352064 Nov 15 12:44:20.889213 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae9167c-f266-4cad-8908-316f56cc6e0c admin admin] Pushing event deleted for resources: {'Network': ['ID=29de8c58-f293-40d7-a944-86383e773ce7,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:20.998818 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-26144292-2ce7-4be2-904d-8cdb82d2eb5d req-60121fe0-df96-43fb-96e6-2d95699e12a7 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0639617 Nov 15 12:44:21.154862 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53578) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:21.165749 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c2b4fc-fa60-466c-8e1f-f90a8a824f7e req-1416b967-9845-4d9d-a758-5a2b5a75aa4e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:21.167253 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-42c2b4fc-fa60-466c-8e1f-f90a8a824f7e req-1416b967-9845-4d9d-a758-5a2b5a75aa4e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0937836 Nov 15 12:44:21.198337 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ae47fe58-878b-4783-ba83-2bbb4bce3b21 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=5d7b948b852c4d75927625acca00a4d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0421619 Nov 15 12:44:21.201048 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53580) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:21.259441 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-42c2b4fc-fa60-466c-8e1f-f90a8a824f7e req-200d1723-69a9-439c-a047-6316b079aa0d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0850985 Nov 15 12:44:21.299493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:21.328320 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:21.383384 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ca456113-be69-41c5-b9f2-c2f343449808 req-23c4e739-4157-4d42-a76c-aae3d4f20745 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0359449 Nov 15 12:44:21.397885 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:21.401287 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:21.403041 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/8ab99b9e-d376-49f2-adcc-6257add5d4d7 HTTP/1.1" status: 204 len: 168 time: 0.2005870 Nov 15 12:44:21.414960 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4c1367-f273-4bb8-87e5-6e7aec987b16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ab99b9e-d376-49f2-adcc-6257add5d4d7,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:21.978844 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6be2c0-156f-41c2-8cd1-33e1a2443d1c req-5f40184d-41b4-4c9d-a2e8-972e0ea8c070 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:21.988272 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da6be2c0-156f-41c2-8cd1-33e1a2443d1c req-5f40184d-41b4-4c9d-a2e8-972e0ea8c070 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0646985 Nov 15 12:44:22.042450 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-da6be2c0-156f-41c2-8cd1-33e1a2443d1c req-b136e2a8-dc27-4415-8d5f-78f8ebc326b6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527332 Nov 15 12:44:22.165531 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a65ca189-5d7c-4f37-ab59-f0ad0d81d16c req-74212001-2316-4e0a-9c80-94e0d5beee17 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0309508 Nov 15 12:44:22.415054 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2426176-bfc0-4763-9b9e-8da2bd6f3e4a req-0f73f0a5-16b8-4d2d-88af-888ffae396a1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:22.417220 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a2426176-bfc0-4763-9b9e-8da2bd6f3e4a req-0f73f0a5-16b8-4d2d-88af-888ffae396a1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0744529 Nov 15 12:44:22.500596 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a2426176-bfc0-4763-9b9e-8da2bd6f3e4a req-80b9b83b-4bfa-4a3b-97e7-8ad7e2e32080 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0756788 Nov 15 12:44:22.600644 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b028f448-806a-4215-80df-f22b08d14f0d req-0af43f5b-ff93-42bd-810d-564199dd5f6f tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0288615 Nov 15 12:44:23.193785 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8022a8-71bf-4a23-b715-b1c52320980c req-c008a58e-c701-44b8-a97f-c78e19477dec tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:23.198674 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db8022a8-71bf-4a23-b715-b1c52320980c req-c008a58e-c701-44b8-a97f-c78e19477dec tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0618403 Nov 15 12:44:23.296723 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db8022a8-71bf-4a23-b715-b1c52320980c req-287aed36-5bf2-431b-a127-0539af374dc5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0881648 Nov 15 12:44:23.304383 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b8e1e57d-e4d9-4ff0-b7a7-0bbb76475ad8 req-1b45e64f-9323-42ce-97ba-6d52e3713948 tempest-AttachVolumeNegativeTest-1541768841 tempest-AttachVolumeNegativeTest-1541768841-project] 10.222.0.44 "GET /v2.0/ports?device_id=133b2150-d5cc-45fc-9ba3-59c17b9f67c1 HTTP/1.1" status: 200 len: 210 time: 0.0310698 Nov 15 12:44:23.684590 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10b50ab-5924-4dc2-b56c-342e972414ab req-930a0d67-0973-4388-b88d-8ff9b6ec873f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:23.687212 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a10b50ab-5924-4dc2-b56c-342e972414ab req-930a0d67-0973-4388-b88d-8ff9b6ec873f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0729263 Nov 15 12:44:23.750336 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a10b50ab-5924-4dc2-b56c-342e972414ab req-dc7bbcc9-8f43-4a63-97ad-6812f8bf34bb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514927 Nov 15 12:44:23.753098 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6c0b13eb-84a1-4096-a6ae-4f288b6eb1c3 req-966e6128-3f9d-4ad6-a73f-c7b073ede73b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0426118 Nov 15 12:44:24.389663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53654) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:24.429508 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-f0a2f814-5879-42ed-87f6-795a9479f188 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:24.432261 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-f0a2f814-5879-42ed-87f6-795a9479f188 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 814 time: 0.2188661 Nov 15 12:44:24.492814 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e1971-7347-4a65-935c-4fd67be53e3e req-50f5f9a5-51d0-41de-a377-9310749166ac tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:24.495557 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e99e1971-7347-4a65-935c-4fd67be53e3e req-50f5f9a5-51d0-41de-a377-9310749166ac tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 943 time: 0.0870545 Nov 15 12:44:24.504830 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Deleting subnet 65d6a75d-c74e-4d29-a0f1-5b5b6db06715 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:44:24.509643 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Request body: {'port': {'device_id': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd', 'admin_state_up': True, 'tenant_id': '171ad5c938bc4bcebdf3addd4a1692dc'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:24.519163 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.540056 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:44:24.590127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.702400 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.733676 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e99e1971-7347-4a65-935c-4fd67be53e3e req-683671e6-c090-424b-9ac2-b185c64d66e9 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2288368 Nov 15 12:44:24.776361 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:24.777599 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.802852 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'port_id': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'mac_address': 'fa:16:3e:3c:6c:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 636, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:44:24.808663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65d6a75d-c74e-4d29-a0f1-5b5b6db06715,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:24.810050 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Made reservation on behalf of 171ad5c938bc4bcebdf3addd4a1692dc for: {'port': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:44:24.818538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.821972 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.828586 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c1710884-b9fb-4c94-94ba-4f71f3af355b admin admin] 10.222.0.44 "DELETE /v2.0/subnets/65d6a75d-c74e-4d29-a0f1-5b5b6db06715 HTTP/1.1" status: 204 len: 168 time: 0.4340365 Nov 15 12:44:24.831699 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53672) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:24.869871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.892695 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:44:24.927989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:24.933134 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:24.973261 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-34ee79b0-2687-4974-b866-6a6c3737329d req-86330a54-aef9-4961-bc99-df783bbf3a87 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0517442 Nov 15 12:44:25.006878 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.012537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:25.025671 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.026205 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.026823 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.027393 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.027906 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.028455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.029009 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.029604 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.030076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.030536 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.031035 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.031398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:25.099637 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1973183e-e053-4dfb-a5b5-f6d44e8d7c48 req-32d353a7-2879-4676-86d7-892f13280290 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:25.101237 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1973183e-e053-4dfb-a5b5-f6d44e8d7c48 req-32d353a7-2879-4676-86d7-892f13280290 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.1672959 Nov 15 12:44:25.108291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Allocated IP 172.20.0.2 (b7abe99c-ff8e-4248-acb4-9c230b0d78fd/3f98b94d-b67f-41a2-843a-6c7c0c51fb68/5e8018cc-22f9-4ebf-831d-0d200a7dac1d) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:44:25.140545 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.184202 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e836cde6-4e01-43bc-9750-09587b9bb5d0']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:25.207314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:25.207855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd9fc4f19-bcef-4f65-b755-b74ba49c22d2') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:25.232683 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.240051 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1973183e-e053-4dfb-a5b5-f6d44e8d7c48 req-90493a6a-7a7e-46e1-906d-63364b3b5939 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1111007 Nov 15 12:44:25.265830 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.283095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Releasing vlan 647 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:44:25.283900 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:44:25.287208 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:44:25.374190 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.397544 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.404578 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.409128 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] 10.222.0.44 "DELETE /v2.0/networks/e836cde6-4e01-43bc-9750-09587b9bb5d0 HTTP/1.1" status: 204 len: 168 time: 0.5754888 Nov 15 12:44:25.410937 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783598ff-5ac1-4483-8fd7-65ba02b70581 admin admin] Pushing event deleted for resources: {'Network': ['ID=e836cde6-4e01-43bc-9750-09587b9bb5d0,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:25.452615 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.498507 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Network b7abe99c-ff8e-4248-acb4-9c230b0d78fd is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:44:25.502430 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:44:25.505373 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:44:25.549477 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:25.550319 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Pushing event updated for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:25.585679 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:25.586341 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.608362 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-40105fa4-3b62-4ad9-89fe-a8c7677461d6 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1110573 Nov 15 12:44:25.650695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Request body: {'port': {'device_id': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:25.690822 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53686) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:25.722897 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.771166 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-701aef8e-7cdc-45f4-afeb-2e699b554616 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=27402858adce449996a04024b968bae3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0788519 Nov 15 12:44:25.776924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53692) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:25.926755 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:25.949938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9451fdba-0b0f-46e0-a10c-423962fbbebd req-29b308f7-c244-4683-ad16-320da4c1cc79 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:25.957794 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9451fdba-0b0f-46e0-a10c-423962fbbebd req-29b308f7-c244-4683-ad16-320da4c1cc79 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 944 time: 0.1246710 Nov 15 12:44:26.011856 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.078275 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9451fdba-0b0f-46e0-a10c-423962fbbebd req-6591b068-d76f-4b79-a54b-b82081d62357 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1068294 Nov 15 12:44:26.101023 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.104722 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.109633 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6074f50c-78c6-4931-a525-0e6079898dec HTTP/1.1" status: 204 len: 168 time: 0.3312829 Nov 15 12:44:26.119962 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e711a3-f7ab-4388-9354-50e149eb752d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6074f50c-78c6-4931-a525-0e6079898dec,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:26.221976 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109d2717-49ae-403e-aba0-a80a6082a85e req-58ba2ccf-980c-47e3-bbf9-102115c277a5 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:26.223559 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-109d2717-49ae-403e-aba0-a80a6082a85e req-58ba2ccf-980c-47e3-bbf9-102115c277a5 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 931 time: 0.1445684 Nov 15 12:44:26.229902 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5e8018cc-22f9-4ebf-831d-0d200a7dac1d {{(pid=108287) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:44:26.240233 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.270376 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.provisioning_blocks [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Transition to ACTIVE for port object 5e8018cc-22f9-4ebf-831d-0d200a7dac1d will not be triggered until provisioned by entity L2. {{(pid=108287) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:44:26.279855 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.338256 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-109d2717-49ae-403e-aba0-a80a6082a85e req-4b40fd77-9284-471a-be37-8c63e269d49e tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034636 Nov 15 12:44:26.362941 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Pushing event updated for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:26.472251 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e2ea0d-0c3e-4827-b9f0-ea368b522a68 req-af3f9060-03c4-40d3-a7fa-e3cf65f7e35c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:26.475173 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a2e2ea0d-0c3e-4827-b9f0-ea368b522a68 req-af3f9060-03c4-40d3-a7fa-e3cf65f7e35c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 943 time: 0.0794640 Nov 15 12:44:26.525053 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Attempting to bind port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:44:26.525632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Attempting to bind port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:44:26.525742 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Attempting to bind port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:44:26.531055 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:44:26.531380 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Attempting to bind port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d on network b7abe99c-ff8e-4248-acb4-9c230b0d78fd {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:44:26.539584 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 44, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:44:26.540003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Checking segment: {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:44:26.540717 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Bound using segment: {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'} {{(pid=108287) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:44:26.542025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.managers [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Bound port: 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'eec395e4-864f-4540-8982-74f84a015989', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd'}}] {{(pid=108287) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:44:26.542025 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.564893 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:44:26.596451 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a2e2ea0d-0c3e-4827-b9f0-ea368b522a68 req-4b70d041-0575-4a9c-9029-a33581da31fa tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1040194 Nov 15 12:44:26.655177 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, cleared binding levels {{(pid=108287) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:44:26.660582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108287) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:44:26.667180 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.733388 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:26.734759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.737157 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] 10.222.0.61 "PUT /v2.0/ports/5e8018cc-22f9-4ebf-831d-0d200a7dac1d HTTP/1.1" status: 200 len: 1093 time: 1.0969758 Nov 15 12:44:26.737814 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:26.741690 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c68755f4-40fa-4a32-8271-e871cacfc462" -d '{"events": [{"name": "network-changed", "server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:26.743774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:26.779590 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'mac_address': 'fa:16:3e:90:c2:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:44:26.827423 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-295b5c85-e96b-4067-9e2e-d56cef0b1389 service neutron] Pushing event updated for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=3']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:26.839124 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-175c5d91-0de6-411f-a25b-ccabbeb06d75 x-openstack-request-id: req-175c5d91-0de6-411f-a25b-ccabbeb06d75 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:26.839453 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:26.839780 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-175c5d91-0de6-411f-a25b-ccabbeb06d75 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:26.840312 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d', 'status': 'completed', 'code': 200} Nov 15 12:44:26.847164 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.869041 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:44:26.898400 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:26.904618 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:26.957980 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-5651396d-4820-4bff-a065-10faede7113d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:26.959635 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-5651396d-4820-4bff-a065-10faede7113d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 1096 time: 0.0746567 Nov 15 12:44:26.970851 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=9']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:27.046304 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-a210bc21-da50-4967-bbab-70a573b12ca7 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d HTTP/1.1" status: 200 len: 217 time: 0.0545907 Nov 15 12:44:27.124308 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-63cbe203-6c23-4aa1-856c-d720ea030385 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.128508 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-63cbe203-6c23-4aa1-856c-d720ea030385 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=3f98b94d-b67f-41a2-843a-6c7c0c51fb68 HTTP/1.1" status: 200 len: 854 time: 0.0707803 Nov 15 12:44:27.174853 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-88b184c1-8dce-4b45-88d1-f51673209b38 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309336 Nov 15 12:44:27.255391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ff1752-e8ef-49bd-9a98-e07b71d2e33b req-fea89e5a-4708-44fa-a163-81596ed3c544 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.257287 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c3ff1752-e8ef-49bd-9a98-e07b71d2e33b req-fea89e5a-4708-44fa-a163-81596ed3c544 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 944 time: 0.0677061 Nov 15 12:44:27.331657 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c3ff1752-e8ef-49bd-9a98-e07b71d2e33b req-e43d46fe-8383-490a-a7d7-227d65a81b7b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669765 Nov 15 12:44:27.331960 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-fb1f8d39-dc1f-4d30-b871-f6d0bd79045a service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1466649 Nov 15 12:44:27.400348 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['36928b8a-e800-43e0-9edd-e13ae44ee93e'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:27.446954 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a1059d96-2d20-40d8-bfc7-63b363874ba8 req-f6ac889e-3bae-4b0a-9774-34b790f55d10 service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1066134 Nov 15 12:44:27.548196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8457b67-1e93-4bdd-ad50-f06a0501a3a5 req-201c2e23-4d5a-4f85-bbad-f3579dc670f0 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.550771 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e8457b67-1e93-4bdd-ad50-f06a0501a3a5 req-201c2e23-4d5a-4f85-bbad-f3579dc670f0 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 943 time: 0.0775323 Nov 15 12:44:27.677611 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e8457b67-1e93-4bdd-ad50-f06a0501a3a5 req-17831460-bb4d-43ed-a1dd-4e216ab00bbd tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1174750 Nov 15 12:44:27.684575 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-aaa7b374-020b-4484-afd0-7d4a630df313 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.687996 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-aaa7b374-020b-4484-afd0-7d4a630df313 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 1096 time: 0.0761321 Nov 15 12:44:27.808374 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab058fc-5d3c-4165-b9d4-bf8d68361bc6 req-c958195f-a1b5-4c5d-9910-efadc85a08fe tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.817000 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2ab058fc-5d3c-4165-b9d4-bf8d68361bc6 req-c958195f-a1b5-4c5d-9910-efadc85a08fe tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0753560 Nov 15 12:44:27.843799 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-fd307a90-6a87-4c0a-88be-7183134e6f40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:27.847440 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-fd307a90-6a87-4c0a-88be-7183134e6f40 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 200 len: 915 time: 0.1472807 Nov 15 12:44:27.933120 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2ab058fc-5d3c-4165-b9d4-bf8d68361bc6 req-135d7326-b862-4fec-a1c7-60951cb72cd8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1151092 Nov 15 12:44:27.939977 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-9e43f88a-b96b-4376-95ad-8f48370727e4 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d HTTP/1.1" status: 200 len: 217 time: 0.0704985 Nov 15 12:44:28.102392 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-e0ebf847-917d-43e8-ada7-6e9583a9a4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:28.103875 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-e0ebf847-917d-43e8-ada7-6e9583a9a4b8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=3f98b94d-b67f-41a2-843a-6c7c0c51fb68 HTTP/1.1" status: 200 len: 854 time: 0.0564437 Nov 15 12:44:28.113016 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e37d25-6100-4d04-8e93-2b336224cfdd req-0e3fb9f7-a04a-42f0-b8c1-b79b4e04cbc5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:28.114906 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d5e37d25-6100-4d04-8e93-2b336224cfdd req-0e3fb9f7-a04a-42f0-b8c1-b79b4e04cbc5 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1057696 Nov 15 12:44:28.184233 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-e841aeb9-4558-4c59-ae1f-8c047796dfa0 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b7abe99c-ff8e-4248-acb4-9c230b0d78fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0677867 Nov 15 12:44:28.277596 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d5e37d25-6100-4d04-8e93-2b336224cfdd req-1396c04f-8be6-434f-8f0c-daf27ea26102 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1473708 Nov 15 12:44:28.398431 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-d5ac3d4b-5b80-40bd-bee5-2a004f9c555d service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2030640 Nov 15 12:44:28.529702 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bdbe7f9-1699-44f6-9955-3c508cc610d8 req-5d82fd4b-e9e2-41dc-9546-ed5e8a3174f1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:28.548364 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8bdbe7f9-1699-44f6-9955-3c508cc610d8 req-5d82fd4b-e9e2-41dc-9546-ed5e8a3174f1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 944 time: 0.0979054 Nov 15 12:44:28.568052 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:44:28.570130 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c68755f4-40fa-4a32-8271-e871cacfc462 req-d1efbffd-83d3-4665-bcd8-3bf502ac98a1 service neutron] 10.222.0.61 "GET /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1519272 Nov 15 12:44:28.658759 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:44:28.667301 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:44:28.668323 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:28.699594 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8bdbe7f9-1699-44f6-9955-3c508cc610d8 req-f0df1a2c-8a00-4c3d-b326-e26c4bfdaf74 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1496124 Nov 15 12:44:28.851483 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94abe50c-f1d8-4eb2-905e-bc19898d0e7a req-2bd46c17-212a-4d1b-9325-aced6d663b43 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:28.853400 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-94abe50c-f1d8-4eb2-905e-bc19898d0e7a req-2bd46c17-212a-4d1b-9325-aced6d663b43 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 943 time: 0.0665429 Nov 15 12:44:28.923533 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53790) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:28.932852 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-94abe50c-f1d8-4eb2-905e-bc19898d0e7a req-00cdc0d0-b384-4e98-ac22-4f150407ef72 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704811 Nov 15 12:44:29.019238 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.050442 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:29.054722 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-052a3022-eba5-43cb-a2b5-10b922d36a47" -d '{"events": [{"server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "name": "network-vif-plugged", "status": "completed", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:29.078707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:29.089697 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.133839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bbbaa1c-ac7a-49be-afca-390ab4a2689d x-openstack-request-id: req-0bbbaa1c-ac7a-49be-afca-390ab4a2689d {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:29.134365 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "name": "network-vif-plugged", "status": "completed", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:29.134703 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-0bbbaa1c-ac7a-49be-afca-390ab4a2689d {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:29.135338 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'code': 200} Nov 15 12:44:29.138135 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8736391-7d01-4fd4-a470-91e2fc9df0d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.180028 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:29.184951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5509c6c0-4a4e-453b-95cc-1c88cd95f994 req-2500874c-4035-42fd-9e85-0c94fbfbd2b8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:29.186574 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5509c6c0-4a4e-453b-95cc-1c88cd95f994 req-2500874c-4035-42fd-9e85-0c94fbfbd2b8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.1379683 Nov 15 12:44:29.289557 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5509c6c0-4a4e-453b-95cc-1c88cd95f994 req-673cf5b9-39fc-42f6-9b8b-0b4309eafb42 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0786316 Nov 15 12:44:29.315431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8736391-7d01-4fd4-a470-91e2fc9df0d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.331143 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8736391-7d01-4fd4-a470-91e2fc9df0d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.413670 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d8736391-7d01-4fd4-a470-91e2fc9df0d2 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=da83bb052ed848a68ca0c8a64e5dcc91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4885087 Nov 15 12:44:29.414495 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8736391-7d01-4fd4-a470-91e2fc9df0d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce502c9f-38df-43ff-a0a7-24a5341d123b,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:29.416995 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53800) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:29.480775 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af09a12-838a-496a-9b0f-6bdf816d68b7 req-d29be594-61a7-45c2-8e0f-4bee9eec66e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:29.484087 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9af09a12-838a-496a-9b0f-6bdf816d68b7 req-d29be594-61a7-45c2-8e0f-4bee9eec66e4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0859399 Nov 15 12:44:29.492445 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.530763 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.582042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522f9cef-166c-427c-9635-c28022a5be39 req-28b71e2b-bcbd-4465-a0db-e5a525f8cc57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:29.584368 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-522f9cef-166c-427c-9635-c28022a5be39 req-28b71e2b-bcbd-4465-a0db-e5a525f8cc57 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1098 time: 0.0995529 Nov 15 12:44:29.589753 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9af09a12-838a-496a-9b0f-6bdf816d68b7 req-8fc39684-fc1d-4ded-8683-7604137787d4 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0923400 Nov 15 12:44:29.603082 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.605821 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:29.607068 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/ce502c9f-38df-43ff-a0a7-24a5341d123b HTTP/1.1" status: 204 len: 168 time: 0.1890943 Nov 15 12:44:29.616224 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a858bc-2147-4097-9187-c337d42f34ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce502c9f-38df-43ff-a0a7-24a5341d123b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:29.677142 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-522f9cef-166c-427c-9635-c28022a5be39 req-6043e813-5b15-44ce-8593-b72be598e8db service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0780234 Nov 15 12:44:29.886941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fe293a-3e90-4948-baeb-db4a9b7ea67d req-fc9dd195-545a-4b8d-b018-ba7a7c9386ac tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:29.888950 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1fe293a-3e90-4948-baeb-db4a9b7ea67d req-fc9dd195-545a-4b8d-b018-ba7a7c9386ac tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0797713 Nov 15 12:44:29.955060 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1fe293a-3e90-4948-baeb-db4a9b7ea67d req-04047708-5d5c-4da1-a90c-7f961674eaac tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558290 Nov 15 12:44:29.999434 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53814) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:30.007748 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-289d7b98-a966-4d9f-bb62-c797c32d6792 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.124470 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9464ab9-15e5-4635-b3ee-341e9c5d9451 req-bb00572d-621d-40bf-b273-0cd7cbe9c770 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:30.127398 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f9464ab9-15e5-4635-b3ee-341e9c5d9451 req-bb00572d-621d-40bf-b273-0cd7cbe9c770 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 943 time: 0.0755157 Nov 15 12:44:30.151753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-289d7b98-a966-4d9f-bb62-c797c32d6792 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.169100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-289d7b98-a966-4d9f-bb62-c797c32d6792 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.221913 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f9464ab9-15e5-4635-b3ee-341e9c5d9451 req-525b80e0-721b-4ab1-ab24-78045a4c2a11 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780878 Nov 15 12:44:30.261183 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-289d7b98-a966-4d9f-bb62-c797c32d6792 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=53f68581d3a64d35b2cce9c3335314c2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2669649 Nov 15 12:44:30.263731 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 53822) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:30.282464 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289d7b98-a966-4d9f-bb62-c797c32d6792 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e27009a-596b-406b-ba1f-90386a4fc3a2,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:30.349397 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.378471 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.462492 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.467733 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.473745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536f0685-50c3-4912-9a63-9676d641d398 req-5bb3b0d7-0ca3-4dfc-8bd9-de9b1a9109ac tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:30.474093 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2e27009a-596b-406b-ba1f-90386a4fc3a2 HTTP/1.1" status: 204 len: 168 time: 0.2053432 Nov 15 12:44:30.474271 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-536f0685-50c3-4912-9a63-9676d641d398 req-5bb3b0d7-0ca3-4dfc-8bd9-de9b1a9109ac tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 944 time: 0.0858142 Nov 15 12:44:30.485354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb4fec2b-46b4-4836-8d44-9a9a5ab17d23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e27009a-596b-406b-ba1f-90386a4fc3a2,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:30.567282 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-536f0685-50c3-4912-9a63-9676d641d398 req-0bfc3f15-da4d-45ab-95f4-345300c5782c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0743008 Nov 15 12:44:30.595310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5e8018cc-22f9-4ebf-831d-0d200a7dac1d details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:44:30.610606 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:44:30.793601 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 36928b8a-e800-43e0-9edd-e13ae44ee93e triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:44:30.794069 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:30.810568 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff7dcef-4f03-4bee-afab-b78c0f4c8102 req-44f504f6-5731-4865-9f88-0c7a7a8ffe93 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:30.823972 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4ff7dcef-4f03-4bee-afab-b78c0f4c8102 req-44f504f6-5731-4865-9f88-0c7a7a8ffe93 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1067019 Nov 15 12:44:30.896376 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:30.899692 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4ff7dcef-4f03-4bee-afab-b78c0f4c8102 req-4b6b5c96-2b8f-41f8-abf3-ac57efd5b179 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743461 Nov 15 12:44:30.915878 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d', 'network_id': 'b7abe99c-ff8e-4248-acb4-9c230b0d78fd', 'port_id': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d', 'mac_address': 'fa:16:3e:19:ef:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3f98b94d-b67f-41a2-843a-6c7c0c51fb68', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:44:31.008728 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:31.011014 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:31.046076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5e8018cc-22f9-4ebf-831d-0d200a7dac1d {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:44:31.088478 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:31.091584 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:31.096366 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:31.102074 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:31.146929 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:31.151196 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7dee4f2-38b3-4b52-8180-b8d7187d71ef" -d '{"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:31.201803 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82cab2d5-1adf-4443-913a-33c98ca84648 req-30bb11e1-685f-4a4e-97ba-d17d857cf06c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:31.215672 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:31.219446 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82cab2d5-1adf-4443-913a-33c98ca84648 req-30bb11e1-685f-4a4e-97ba-d17d857cf06c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.1147690 Nov 15 12:44:31.269201 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-936008f6-0b71-4ae7-a935-bdec4777956b x-openstack-request-id: req-936008f6-0b71-4ae7-a935-bdec4777956b {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:31.269681 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-plugged", "status": "completed", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:31.270081 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-936008f6-0b71-4ae7-a935-bdec4777956b {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:31.270635 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'code': 200} Nov 15 12:44:31.294204 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=10']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:31.320878 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82cab2d5-1adf-4443-913a-33c98ca84648 req-f9d77ba8-339c-4ee6-933a-f4037a9354e6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1001284 Nov 15 12:44:31.415260 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25acb88a-4956-4f64-934d-4ee17fd2fca3 req-de6979f0-623c-4b75-8930-ae0a3f92da67 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:31.416864 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-25acb88a-4956-4f64-934d-4ee17fd2fca3 req-de6979f0-623c-4b75-8930-ae0a3f92da67 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.0824530 Nov 15 12:44:31.472733 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-25acb88a-4956-4f64-934d-4ee17fd2fca3 req-15b9ebf2-c31c-46e7-83cf-296a92c1799a tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493770 Nov 15 12:44:31.702816 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ab473c-05c6-4f37-a5e5-a3c90bedc9b0 req-b084ecdf-e87f-4c58-85a9-d3453195b8ac tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:31.704452 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61ab473c-05c6-4f37-a5e5-a3c90bedc9b0 req-b084ecdf-e87f-4c58-85a9-d3453195b8ac tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0562115 Nov 15 12:44:31.763961 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61ab473c-05c6-4f37-a5e5-a3c90bedc9b0 req-5d8c6324-95b0-49a2-aaa6-081e4f3629f4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527632 Nov 15 12:44:32.032235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90887142-5df2-47c2-9411-b590b2163705 req-c936b65b-178c-4dde-a02e-91e7bb11b6d3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:32.033863 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-90887142-5df2-47c2-9411-b590b2163705 req-c936b65b-178c-4dde-a02e-91e7bb11b6d3 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0510833 Nov 15 12:44:32.087163 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-90887142-5df2-47c2-9411-b590b2163705 req-8f6b2f2c-f94c-45ed-90d5-c2531ddc3391 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463612 Nov 15 12:44:32.493867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d1fc2e-cc2a-4a91-aefd-e8ca87bb2e07 req-26b653c5-ffce-491a-b0ed-b4d6dbe85476 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:32.495489 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-88d1fc2e-cc2a-4a91-aefd-e8ca87bb2e07 req-26b653c5-ffce-491a-b0ed-b4d6dbe85476 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0751853 Nov 15 12:44:32.564097 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-88d1fc2e-cc2a-4a91-aefd-e8ca87bb2e07 req-24449131-6532-4f1a-9bea-cfd5d1388534 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0603566 Nov 15 12:44:32.621316 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd183263-042d-4c1f-9d0f-61904c532d04 req-050ce68a-cc4e-46d6-bf5b-d1f8b0ff211c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:32.622926 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cd183263-042d-4c1f-9d0f-61904c532d04 req-050ce68a-cc4e-46d6-bf5b-d1f8b0ff211c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.0653682 Nov 15 12:44:32.676886 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-cd183263-042d-4c1f-9d0f-61904c532d04 req-0270730d-6f88-4901-b555-d3c9fbfd3092 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452700 Nov 15 12:44:33.097362 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bc344c-4630-4f6a-b071-28c05a85cb3c req-35d82e71-9a95-43ac-820a-2fe6658fb116 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:33.098914 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9bc344c-4630-4f6a-b071-28c05a85cb3c req-35d82e71-9a95-43ac-820a-2fe6658fb116 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.2313244 Nov 15 12:44:33.152937 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9bc344c-4630-4f6a-b071-28c05a85cb3c req-1eff83f8-934c-4a4f-8f71-55a82718217a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479720 Nov 15 12:44:33.214457 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3575dab6-7d61-406c-8a4d-81d6763170cb req-9b319b03-f8f8-448d-8d97-0ee84da1fd8b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:33.216021 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3575dab6-7d61-406c-8a4d-81d6763170cb req-9b319b03-f8f8-448d-8d97-0ee84da1fd8b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0573041 Nov 15 12:44:33.266414 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3575dab6-7d61-406c-8a4d-81d6763170cb req-dba8d0d4-774c-4d5a-9afb-6173df338c0e tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432868 Nov 15 12:44:33.335015 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1aab00fc-1fd1-4764-a2e1-0df155423889 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:33.692772 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116a4567-b42d-475d-8c18-b9fb0d21a3f4 req-f4437f02-99a1-4062-9d08-5ef63cae14b5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:33.694322 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-116a4567-b42d-475d-8c18-b9fb0d21a3f4 req-f4437f02-99a1-4062-9d08-5ef63cae14b5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0497932 Nov 15 12:44:33.748869 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-116a4567-b42d-475d-8c18-b9fb0d21a3f4 req-0d37d782-79cb-4806-9dee-42e3d98b000b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484834 Nov 15 12:44:33.810312 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc5784b-23de-4447-b911-7e5540c3e43e req-d7d20901-9bc6-48e1-807a-f37400ce6063 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:33.811860 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-edc5784b-23de-4447-b911-7e5540c3e43e req-d7d20901-9bc6-48e1-807a-f37400ce6063 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.0641060 Nov 15 12:44:33.866250 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-edc5784b-23de-4447-b911-7e5540c3e43e req-711d0a28-c6a1-45db-8861-bd8a805e7f67 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475726 Nov 15 12:44:34.285851 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46293174-7139-4868-8c26-57d54527bbea req-7637b139-52b3-4d59-aec5-e822007a98d5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:34.287641 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46293174-7139-4868-8c26-57d54527bbea req-7637b139-52b3-4d59-aec5-e822007a98d5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0494790 Nov 15 12:44:34.341626 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46293174-7139-4868-8c26-57d54527bbea req-1363b157-9894-4e76-812f-d240012e0305 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475903 Nov 15 12:44:34.389879 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c9ef59-6759-428a-9fce-b88a2eb7bdd8 req-4595c6ad-7e2a-4640-b166-e04290242a32 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:34.391377 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a9c9ef59-6759-428a-9fce-b88a2eb7bdd8 req-4595c6ad-7e2a-4640-b166-e04290242a32 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0520704 Nov 15 12:44:34.443619 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a9c9ef59-6759-428a-9fce-b88a2eb7bdd8 req-4dec850e-d466-4f90-b624-3cd22541d730 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462196 Nov 15 12:44:34.939968 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8586220b-4805-43d4-a40c-06288ff61e2c req-94b349c6-4ef9-4b66-a847-645b2283ef3d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:34.942712 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8586220b-4805-43d4-a40c-06288ff61e2c req-94b349c6-4ef9-4b66-a847-645b2283ef3d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0882506 Nov 15 12:44:35.042308 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8586220b-4805-43d4-a40c-06288ff61e2c req-21bf815c-4be6-4cf2-97a9-7c8aacd0ef70 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0898914 Nov 15 12:44:35.106845 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf73c36-4a23-42ed-86a1-00efcdf90fbd req-e9b30be8-f75f-4fe2-a466-e88f55458483 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:35.108473 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0cf73c36-4a23-42ed-86a1-00efcdf90fbd req-e9b30be8-f75f-4fe2-a466-e88f55458483 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.1210048 Nov 15 12:44:35.190295 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0cf73c36-4a23-42ed-86a1-00efcdf90fbd req-2956c762-76bf-4734-a459-5352185fd54e tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710704 Nov 15 12:44:35.366967 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['5e8018cc-22f9-4ebf-831d-0d200a7dac1d'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:35.522361 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3e4f22-111e-4068-867e-da4b1faddf62 req-b1e5c4e6-4c56-4b98-8a79-c93cb1c2dc1a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:35.524445 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7a3e4f22-111e-4068-867e-da4b1faddf62 req-b1e5c4e6-4c56-4b98-8a79-c93cb1c2dc1a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0853105 Nov 15 12:44:35.613298 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68351adb-ac71-40ab-86c1-f7efa4b816a0 req-88daac71-ce44-4ba4-85d8-f91f33dfa010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:35.615909 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-68351adb-ac71-40ab-86c1-f7efa4b816a0 req-88daac71-ce44-4ba4-85d8-f91f33dfa010 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1099 time: 0.1218939 Nov 15 12:44:35.657932 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7a3e4f22-111e-4068-867e-da4b1faddf62 req-fce3f8e1-5413-4a45-b9ff-2e65fb70ab6a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1117985 Nov 15 12:44:35.748230 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-68351adb-ac71-40ab-86c1-f7efa4b816a0 req-9ec7560d-70c8-46c8-b415-c3754933ae49 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1151011 Nov 15 12:44:35.756515 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:44:35.762131 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ef4c6a-5290-4f8c-8fd6-4db73cb82594 req-c98f904f-f6d7-4619-940b-80a3937ac846 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:35.764340 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2ef4c6a-5290-4f8c-8fd6-4db73cb82594 req-c98f904f-f6d7-4619-940b-80a3937ac846 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1343012 Nov 15 12:44:35.768426 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e2373f6f-c245-4580-80b2-2e6b5b07b0c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:35.826602 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c2ef4c6a-5290-4f8c-8fd6-4db73cb82594 req-289b03c0-9c56-4ef6-b7f5-bced675bfbb2 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544949 Nov 15 12:44:36.206744 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4327bb9-da1e-48ea-8c9d-3819eaa98308 req-f1dec096-f41c-41a5-b76e-bbdecda213e4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:36.209465 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e4327bb9-da1e-48ea-8c9d-3819eaa98308 req-f1dec096-f41c-41a5-b76e-bbdecda213e4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0716534 Nov 15 12:44:36.304409 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e4327bb9-da1e-48ea-8c9d-3819eaa98308 req-acdb5236-fab1-452a-abbd-53acbb2680a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0830023 Nov 15 12:44:36.407055 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed81aa75-fb61-4a19-bdc1-19131974ddea req-537b1b63-ca53-4e19-ace3-bb8743d09f35 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:36.409764 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ed81aa75-fb61-4a19-bdc1-19131974ddea req-537b1b63-ca53-4e19-ace3-bb8743d09f35 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.0890145 Nov 15 12:44:36.495982 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ed81aa75-fb61-4a19-bdc1-19131974ddea req-c1bcd715-b956-4312-83bd-4ef44a99cac8 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779729 Nov 15 12:44:36.521075 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f45249b5-03f4-40e1-a22f-c985d7989dae req-ec88913b-a57e-4fdd-acd3-eb4bac965701 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:36.523297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f45249b5-03f4-40e1-a22f-c985d7989dae req-ec88913b-a57e-4fdd-acd3-eb4bac965701 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.1154461 Nov 15 12:44:36.588816 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f45249b5-03f4-40e1-a22f-c985d7989dae req-2faf9643-d0c3-45df-8d5c-6426cc38aa92 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0536292 Nov 15 12:44:36.632427 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 53954) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:36.881307 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:36.975277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-038afbff-5d95-464f-bdc8-e1928eed9c40 tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:36.978122 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-038afbff-5d95-464f-bdc8-e1928eed9c40 tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1093 time: 0.3440778 Nov 15 12:44:36.990573 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 53974) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:37.000855 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'port_id': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address': '172.20.0.9'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:37.024076 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23201e68-9c37-44ac-84bd-4d1d497b6b53 req-019c844b-6a12-4277-971a-f116cb3afd39 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:37.024788 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf09b1be-2c82-49d5-a55d-7b40b1423063 req-f6ba6c50-2e81-4cb9-9bc8-3f50796b3485 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:37.027717 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-23201e68-9c37-44ac-84bd-4d1d497b6b53 req-019c844b-6a12-4277-971a-f116cb3afd39 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.1644325 Nov 15 12:44:37.033420 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf09b1be-2c82-49d5-a55d-7b40b1423063 req-f6ba6c50-2e81-4cb9-9bc8-3f50796b3485 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0847809 Nov 15 12:44:37.093177 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf09b1be-2c82-49d5-a55d-7b40b1423063 req-0ea5c8ba-4117-44a6-8d7f-2d0b7e359d3c tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588140 Nov 15 12:44:37.105266 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:37.193195 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-23201e68-9c37-44ac-84bd-4d1d497b6b53 req-70831940-770a-4676-9094-37f988e2e6eb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1492922 Nov 15 12:44:37.267012 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef8b189e-2eca-4c2f-af61-d3a2cc66a26a req-b40a6716-beea-44ce-bea0-dedee50acf74 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:37.268693 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ef8b189e-2eca-4c2f-af61-d3a2cc66a26a req-b40a6716-beea-44ce-bea0-dedee50acf74 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0836868 Nov 15 12:44:37.287483 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-de5fb28d-2f63-4d04-94bf-20ae3f25e19f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:37.289821 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-de5fb28d-2f63-4d04-94bf-20ae3f25e19f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.0939753 Nov 15 12:44:37.351013 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ef8b189e-2eca-4c2f-af61-d3a2cc66a26a req-26b0df2a-e49b-4654-bbb4-4222a1f98d22 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671835 Nov 15 12:44:37.372456 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53982) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:37.411872 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:37.513809 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Deleting port b9ecf6e8-fd12-4b4f-9471-efed756013e7 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:44:37.514132 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:37.645889 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3475021-0a0c-4e97-a578-9a6bc56f5886 tempest-TestMinimumBasicScenario-354840147 tempest-TestMinimumBasicScenario-354840147-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:37.650907 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c3475021-0a0c-4e97-a578-9a6bc56f5886 tempest-TestMinimumBasicScenario-354840147 tempest-TestMinimumBasicScenario-354840147-project-admin] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1093 time: 0.2773454 Nov 15 12:44:37.651650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 53996) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:37.657045 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'port_id': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'fixed_ip_address': '172.20.0.5'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:37.704338 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.27.0.107 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/286ef0a5-b060-410b-bd75-5b7daf8bc19b) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:44:37.718828 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for floatingip, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:37.946824 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.243811 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] For port b9ecf6e8-fd12-4b4f-9471-efed756013e7, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=b9ecf6e8-fd12-4b4f-9471-efed756013e7,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:38.244439 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.278963 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Calling delete_port for b9ecf6e8-fd12-4b4f-9471-efed756013e7 owned by compute:nova {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:44:38.322297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0ae2a5-d2c4-4d9a-b1c0-b5c6d58bad3c req-f52cc5cd-08bf-4c52-b0ad-e08a3e040ceb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:38.329546 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba0ae2a5-d2c4-4d9a-b1c0-b5c6d58bad3c req-f52cc5cd-08bf-4c52-b0ad-e08a3e040ceb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 945 time: 0.1103654 Nov 15 12:44:38.338259 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.357712 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18522e1-4351-4536-ac8d-f6e5c832c28b req-39886410-9590-4c8f-b653-d3bdab591eaa tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:38.363345 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f18522e1-4351-4536-ac8d-f6e5c832c28b req-39886410-9590-4c8f-b653-d3bdab591eaa tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 944 time: 0.7027183 Nov 15 12:44:38.421691 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba0ae2a5-d2c4-4d9a-b1c0-b5c6d58bad3c req-6bcd88c6-c48f-424c-bc1a-46982dd5b28f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862525 Nov 15 12:44:38.501801 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.517043 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f18522e1-4351-4536-ac8d-f6e5c832c28b req-ae54d478-c598-49dc-885d-eb0c0d307fa7 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116240 Nov 15 12:44:38.579703 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5e8018cc-22f9-4ebf-831d-0d200a7dac1d up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:44:38.611564 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c964cd8-7a3c-4e7a-bb6e-5261c06d189f req-f402e043-8ebc-4367-9334-4b3b14e30e25 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:38.613867 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4c964cd8-7a3c-4e7a-bb6e-5261c06d189f req-f402e043-8ebc-4367-9334-4b3b14e30e25 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0751073 Nov 15 12:44:38.649375 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.657805 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.666481 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:44:38.675566 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:44:38.675942 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.726209 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:44:38.731363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:44:38.734348 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4c964cd8-7a3c-4e7a-bb6e-5261c06d189f req-d947d299-086a-4fe0-8ce7-9ed210576390 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1123118 Nov 15 12:44:38.759066 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:44:38.761744 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['08424d3d-6d1d-4f23-b097-340c6cd4f857', 'b9ecf6e8-fd12-4b4f-9471-efed756013e7'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:38.816626 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Allocated IP 172.27.0.96 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/2639a22c-e6df-46f3-9ff3-c585c877575b) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:44:38.857139 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=286ef0a5-b060-410b-bd75-5b7daf8bc19b,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:38.902733 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] No DVR routers for this DVR port b9ecf6e8-fd12-4b4f-9471-efed756013e7 on host hv-cinder-80382 {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:44:38.910413 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:38.915605 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6b2b1c41-ce4f-4fcb-9100-26a317e2dacc req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "DELETE /v2.0/ports/b9ecf6e8-fd12-4b4f-9471-efed756013e7 HTTP/1.1" status: 204 len: 173 time: 1.6017818 Nov 15 12:44:38.939107 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'name': 'network-vif-deleted', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:38.941812 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da3784a9-8f76-49f2-babc-807c600d95f7" -d '{"events": [{"server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "name": "network-vif-deleted", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:38.949827 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3955734a-0ae1-4db7-b23a-564cb3e58d57 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Pushing event deleted for resources: {'Port': ['ID=b9ecf6e8-fd12-4b4f-9471-efed756013e7,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:39.030751 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd97611b-4792-45c3-a4dd-b870ddf807a5 x-openstack-request-id: req-fd97611b-4792-45c3-a4dd-b870ddf807a5 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:39.031791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "455f0512-57e9-4b54-9c99-b1dde15cea80", "name": "network-vif-deleted", "tag": "b9ecf6e8-fd12-4b4f-9471-efed756013e7", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:39.031791 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-fd97611b-4792-45c3-a4dd-b870ddf807a5 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:39.032369 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '455f0512-57e9-4b54-9c99-b1dde15cea80', 'name': 'network-vif-deleted', 'tag': 'b9ecf6e8-fd12-4b4f-9471-efed756013e7', 'status': 'completed', 'code': 200} Nov 15 12:44:39.069965 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.107307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.165030 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:39.167409 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af4479cb-31a1-4b34-a582-1da660e7e0c2" -d '{"events": [{"server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "name": "network-vif-plugged", "status": "completed", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:39.192698 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:39.194152 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.210921 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.259947 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.329358 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:39.336198 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bbad2f63-bfdd-437a-b35d-a5522bdfbbd3 x-openstack-request-id: req-bbad2f63-bfdd-437a-b35d-a5522bdfbbd3 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:39.337951 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "name": "network-vif-plugged", "status": "completed", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:39.339972 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-bbad2f63-bfdd-437a-b35d-a5522bdfbbd3 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:39.340560 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d', 'code': 200} Nov 15 12:44:39.372971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:44:39.378176 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:44:39.380279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'Port': ['ID=2639a22c-e6df-46f3-9ff3-c585c877575b,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:39.382760 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:44:39.791353 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc0bd6a-553c-4cb6-93f6-7936e5029231 req-7ca037a3-14a8-4dc6-af72-8fa61f058c75 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:39.793925 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2fc0bd6a-553c-4cb6-93f6-7936e5029231 req-7ca037a3-14a8-4dc6-af72-8fa61f058c75 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.1144414 Nov 15 12:44:39.812702 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a77ee1c0-af3b-4ea0-99e5-434ce54409ce req-e5a6c0ac-d584-4a0d-8d88-0f76ff7d6e4b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=455f0512-57e9-4b54-9c99-b1dde15cea80 HTTP/1.1" status: 200 len: 210 time: 0.1514122 Nov 15 12:44:39.897541 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:39.929188 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90324e51-3740-4363-8e49-3f5dfd8b07bb req-e84a4b26-d666-4f1a-a944-a108ec0e1ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:39.931843 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-90324e51-3740-4363-8e49-3f5dfd8b07bb req-e84a4b26-d666-4f1a-a944-a108ec0e1ce6 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 1098 time: 0.1828444 Nov 15 12:44:39.978570 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2fc0bd6a-553c-4cb6-93f6-7936e5029231 req-4422375e-8109-4a49-9f9d-2ff90517f38b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1622655 Nov 15 12:44:40.041721 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54074) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:40.085041 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.191705 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.194990 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-90324e51-3740-4363-8e49-3f5dfd8b07bb req-72943094-d0fe-47cc-828e-a5683fff2ef1 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2269511 Nov 15 12:44:40.220999 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.246695 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d89905d-0d68-405e-9617-d719e75b98d1 req-6df8340b-1751-4624-a668-105f802db396 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:40.252575 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6d89905d-0d68-405e-9617-d719e75b98d1 req-6df8340b-1751-4624-a668-105f802db396 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.2607419 Nov 15 12:44:40.326309 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e43fd678-1bf0-409a-9849-64d907424658 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.441247 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6d89905d-0d68-405e-9617-d719e75b98d1 req-31067c11-e294-4f87-94ba-01107f7bf857 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1635487 Nov 15 12:44:40.551316 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e43fd678-1bf0-409a-9849-64d907424658 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.557056 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e43fd678-1bf0-409a-9849-64d907424658 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.584368 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.603289 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.648140 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e43fd678-1bf0-409a-9849-64d907424658 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b715f3eb276c4bb3969c94a94870db60&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6046972 Nov 15 12:44:40.650948 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e43fd678-1bf0-409a-9849-64d907424658 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3fcb562-b835-4656-acbc-1413a37c7222,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:40.660828 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54086) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:40.731469 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=286ef0a5-b060-410b-bd75-5b7daf8bc19b,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:40.748577 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.771778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.778035 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.854381 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'Port': ['ID=2639a22c-e6df-46f3-9ff3-c585c877575b,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:40.868761 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.889989 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:40.946588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:41.006354 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP 2ed2e1f6-c353-477a-a6df-fdfd10382523 associated. External IP: 172.27.0.107, port: d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8. Nov 15 12:44:41.050957 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Floating IP c3872a6d-0405-43ca-827b-d5dfe4e3d95e associated. External IP: 172.27.0.96, port: 66d80ca0-34c0-4ae9-a96c-a8004410e3af. Nov 15 12:44:41.110059 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:41.115220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:41.120832 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/c3fcb562-b835-4656-acbc-1413a37c7222 HTTP/1.1" status: 204 len: 168 time: 0.4553058 Nov 15 12:44:41.137328 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a8fc3a-a357-462d-b8dd-63cab15321c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3fcb562-b835-4656-acbc-1413a37c7222,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:41.267446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d512bfd3-638b-4607-af84-9c74bd501071 req-b0b5b71c-281f-4dba-b9ac-c07e8e4a86d7 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:41.270100 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d512bfd3-638b-4607-af84-9c74bd501071 req-b0b5b71c-281f-4dba-b9ac-c07e8e4a86d7 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.1237268 Nov 15 12:44:41.353490 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d512bfd3-638b-4607-af84-9c74bd501071 req-fbc822f7-66ed-4927-8876-8da5600358a1 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666959 Nov 15 12:44:41.462908 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-959ce415-f73b-4143-b088-d27ec8f2c09e req-f1abef1f-aa36-4bbb-840e-5de4e0471708 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:41.467989 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-959ce415-f73b-4143-b088-d27ec8f2c09e req-f1abef1f-aa36-4bbb-840e-5de4e0471708 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1284180 Nov 15 12:44:41.503976 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:44:41.564538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:44:41.635157 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-959ce415-f73b-4143-b088-d27ec8f2c09e req-45c09339-a4ca-4a8b-81bf-bef5e1e708bf tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291025 Nov 15 12:44:41.729176 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54132) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:41.761453 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3a1e9f3d-c532-44c2-92a3-0dd256aa0998 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:41.777952 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:44:41.796354 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:44:41.818525 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:41.819370 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:41.830582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:41.863589 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:44:41.881044 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Sync routers for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:44:41.911139 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:41.912950 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:41.924193 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-75208c05-4e11-4807-9af1-31113c07d706 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.9221292 Nov 15 12:44:41.924193 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:41.924193 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d415631b-a102-4277-b7ea-81fcdb736775" -d '{"events": [{"name": "network-changed", "server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:41.938823 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.014267 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:42.015275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ead83958-821d-4870-b674-1736595784f4 x-openstack-request-id: req-ead83958-821d-4870-b674-1736595784f4 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:42.015562 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:42.015858 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-ead83958-821d-4870-b674-1736595784f4 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:42.016298 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'status': 'completed', 'code': 200} Nov 15 12:44:42.020850 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-013de3b9-fa46-4389-b730-3ddfa95b73ab tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 4.3679500 Nov 15 12:44:42.023863 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54146) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:42.028921 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-294809760', 'description': 'tempest-secgroup-smoke-294809760 description', 'project_id': 'df44545940f44d95ad307aa0fea120c4'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:42.034505 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:42.041407 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd827542-97eb-446b-8c35-9b0c2c9e8d90" -d '{"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:42.083992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.091813 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3a1e9f3d-c532-44c2-92a3-0dd256aa0998 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.099321 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3a1e9f3d-c532-44c2-92a3-0dd256aa0998 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.184050 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3a1e9f3d-c532-44c2-92a3-0dd256aa0998 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=4a45a00d3a8c4e2f83abf2e5d33bfd15&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4535599 Nov 15 12:44:42.186232 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a1e9f3d-c532-44c2-92a3-0dd256aa0998 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58e32eaa-8ba7-4e3a-b3c0-db22eefe3827,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:42.190046 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54150) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:42.224644 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-530f62d7-b778-4c1a-bf51-3bc2269da1ec x-openstack-request-id: req-530f62d7-b778-4c1a-bf51-3bc2269da1ec {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:42.225128 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:42.228502 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-530f62d7-b778-4c1a-bf51-3bc2269da1ec {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:42.229171 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:44:42.257359 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:42.273374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d415631b-a102-4277-b7ea-81fcdb736775 req-d1badcdc-9eb4-4742-b7b5-23de0ec0834a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:42.276152 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-d1badcdc-9eb4-4742-b7b5-23de0ec0834a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1098 time: 0.1369576 Nov 15 12:44:42.327831 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.337622 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.369244 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.429504 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '2ed2e1f6-c353-477a-a6df-fdfd10382523', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 464, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:3c:6c:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49c75c58-0b7e-448b-8179-0af71aebd844', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:42.435480 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c1bab170-a392-46e1-87bf-5ff04474b15e,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:42.442137 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.458800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.467097 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b5df7929-96d8-4d54-8b02-ec3344e202ff tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.4388099 Nov 15 12:44:42.468067 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:44:42.468451 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54156) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:42.480765 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:42.481827 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:42.489394 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:42.652670 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device b9ecf6e8-fd12-4b4f-9471-efed756013e7 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:44:42.701382 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: b9ecf6e8-fd12-4b4f-9471-efed756013e7 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:44:42.701755 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device b9ecf6e8-fd12-4b4f-9471-efed756013e7 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:44:42.721332 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:42.755278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.764683 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-f5a624b5-31fb-4970-9d95-e01faa37fd6f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2172232 Nov 15 12:44:42.780878 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-c23de907-d073-4e5c-beee-9be2772602af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:42.782529 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-c23de907-d073-4e5c-beee-9be2772602af service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1098 time: 0.2458115 Nov 15 12:44:42.783204 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.796169 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:42.797997 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/58e32eaa-8ba7-4e3a-b3c0-db22eefe3827 HTTP/1.1" status: 204 len: 168 time: 0.6070633 Nov 15 12:44:42.830378 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee340bd-34f6-4f77-b925-d9e647670730 req-51ce843c-cda2-47dc-b8e7-75898460e11b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:42.839620 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eee340bd-34f6-4f77-b925-d9e647670730 req-51ce843c-cda2-47dc-b8e7-75898460e11b tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.2731698 Nov 15 12:44:42.874138 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d0f763-33b1-44cb-b845-066e1dc8955e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58e32eaa-8ba7-4e3a-b3c0-db22eefe3827,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:42.928345 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d415631b-a102-4277-b7ea-81fcdb736775 req-50403e67-13d6-4d2b-9f98-4dfeb7d5ff31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:42.932925 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-50403e67-13d6-4d2b-9f98-4dfeb7d5ff31 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.4026611 Nov 15 12:44:43.238306 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c3872a6d-0405-43ca-827b-d5dfe4e3d95e', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'floating_ip_address': '172.27.0.96', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'port_id': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'mac_address': 'fa:16:3e:3c:c6:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:43.246443 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eee340bd-34f6-4f77-b925-d9e647670730 req-d19575e8-c099-4d5f-b99a-842992e54e54 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4055946 Nov 15 12:44:43.316015 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-1ab52d13-0287-4cbe-90bf-0c6d64bcdc8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:43.316508 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Checking router: 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:44:43.319683 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-1ab52d13-0287-4cbe-90bf-0c6d64bcdc8e service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 1099 time: 0.3245568 Nov 15 12:44:43.323534 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:43.337978 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:43.361856 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:43.364557 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:43.450738 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80a3cb83-193c-4bec-bb7f-cb9031880e11,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:43.602238 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:43.604576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.605077 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.605618 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.606133 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.606601 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.607060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.607510 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.611078 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.611736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.612220 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.612664 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.613096 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:43.636088 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-ac7b9a2a-3252-41a9-8dd0-117913e77089 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:43.648147 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-ac7b9a2a-3252-41a9-8dd0-117913e77089 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.7991629 Nov 15 12:44:43.688283 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e631166-9688-4ea6-8735-b10a32dbdf4d req-ea52cefb-2ba2-43b1-ad66-37010a27e1d7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:43.701197 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e631166-9688-4ea6-8735-b10a32dbdf4d req-ea52cefb-2ba2-43b1-ad66-37010a27e1d7 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.9053795 Nov 15 12:44:43.738137 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '2ed2e1f6-c353-477a-a6df-fdfd10382523', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 464, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:3c:6c:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49c75c58-0b7e-448b-8179-0af71aebd844', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:43.764452 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-2f31bf46-a4d7-4be6-8f7c-becc7ad1e696 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 HTTP/1.1" status: 200 len: 999 time: 0.8054497 Nov 15 12:44:43.794217 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:43.796559 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3f8140c1-02e0-4aad-81f8-b971c886197c tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3246791 Nov 15 12:44:43.805907 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54190) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:43.829594 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bb618cb-3087-4895-935a-7aa51beb4b55 None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '2ed2e1f6-c353-477a-a6df-fdfd10382523', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.107', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 464, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:3c:6c:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49c75c58-0b7e-448b-8179-0af71aebd844', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:44:43.833866 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:43.877070 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e631166-9688-4ea6-8735-b10a32dbdf4d req-c059e30b-21a8-4df3-bbb6-72662c359c5f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1646128 Nov 15 12:44:43.901052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d415631b-a102-4277-b7ea-81fcdb736775 req-04e86125-5982-420e-9231-c907b4ff667c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:43.902995 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-04e86125-5982-420e-9231-c907b4ff667c service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.1148748 Nov 15 12:44:43.936778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:43.968869 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-82389120-fbb7-4cdb-8f24-dbd85a380c1a service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 998 time: 0.2924490 Nov 15 12:44:44.045959 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d415631b-a102-4277-b7ea-81fcdb736775 req-cacd4058-b369-417a-958c-098f872db405 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.048904 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-cacd4058-b369-417a-958c-098f872db405 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1227615 Nov 15 12:44:44.100184 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:44.105022 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-a0c14ed0-a4ea-4176-95e4-5faf645b4df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.108169 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-a0c14ed0-a4ea-4176-95e4-5faf645b4df5 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.7214720 Nov 15 12:44:44.264813 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-b23f5bde-0a72-412f-9b8d-314538dcfb6e service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 200 len: 1001 time: 0.1337800 Nov 15 12:44:44.270905 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-9d5a8077-e644-4b78-9ccb-4fc79bd8d131 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.273941 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-9d5a8077-e644-4b78-9ccb-4fc79bd8d131 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.2930634 Nov 15 12:44:44.286140 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c3872a6d-0405-43ca-827b-d5dfe4e3d95e', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'floating_ip_address': '172.27.0.96', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'port_id': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'mac_address': 'fa:16:3e:3c:c6:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:44.295192 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0d65806-81fc-4a77-80a0-d1d1cfcaeda0 None None] New status for floating IP 2ed2e1f6-c353-477a-a6df-fdfd10382523: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:44:44.307186 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:44.327788 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-fbf1a15e-7a88-4a27-8629-88a6501ebfcf service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2578743 Nov 15 12:44:44.338971 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adc45e91-61d2-4037-b698-3ba841453d41 None None] The sync data for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi is: [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c3872a6d-0405-43ca-827b-d5dfe4e3d95e', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'floating_ip_address': '172.27.0.96', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'port_id': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'mac_address': 'fa:16:3e:3c:c6:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:44:39Z', 'updated_at': '2021-11-15T12:44:39Z', 'revision_number': 0, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:44:44.373319 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:44.493494 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd43b13a-942e-4d9f-b101-9340af46fc89,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:44.642774 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:44.644984 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f0110180-969c-4505-bc9a-9479c437538d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.8288577 Nov 15 12:44:44.653843 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54202) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:44.655700 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-b13315dd-91f3-4c3f-8258-3dec099d3fa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.657914 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-b13315dd-91f3-4c3f-8258-3dec099d3fa8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.3554299 Nov 15 12:44:44.663989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:44.673147 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-57d0930d-6be4-47a7-b562-7ea7d29366a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.674679 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-57d0930d-6be4-47a7-b562-7ea7d29366a9 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3743463 Nov 15 12:44:44.680226 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-dce213ad-a92a-49a2-8536-87d0c595afcd service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3343284 Nov 15 12:44:44.754327 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375e5844-2b10-4bd1-b339-debfc8c81224 req-8a57cab8-93e1-45d4-af36-40dadad57397 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.757349 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-375e5844-2b10-4bd1-b339-debfc8c81224 req-8a57cab8-93e1-45d4-af36-40dadad57397 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.2406466 Nov 15 12:44:44.863273 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38f74dac-5730-42ef-8c9a-817503d31b00 None None] New status for floating IP c3872a6d-0405-43ca-827b-d5dfe4e3d95e: ACTIVE {{(pid=108288) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:44:44.889095 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-375e5844-2b10-4bd1-b339-debfc8c81224 req-ed77f7a6-71b5-4d95-9c8d-2f88e5f1d79c tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109211 Nov 15 12:44:44.905871 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:44.951480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-70a1c45a-7ae4-4fee-b940-64e72c00eeb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:44.953366 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-70a1c45a-7ae4-4fee-b940-64e72c00eeb1 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2776294 Nov 15 12:44:45.118687 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-b37dd610-093b-4296-b567-5869df951ba6 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3583171 Nov 15 12:44:45.154297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.180588 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.190934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fab25e-08bb-4953-8fc4-3d280a86efe0 req-520daaa8-a58e-488e-8b85-12fd54ed0b20 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:45.211304 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a7fab25e-08bb-4953-8fc4-3d280a86efe0 req-520daaa8-a58e-488e-8b85-12fd54ed0b20 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1885183 Nov 15 12:44:45.324685 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a7fab25e-08bb-4953-8fc4-3d280a86efe0 req-9760e5bb-1981-426d-bd72-d8dfe31c9c28 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151640 Nov 15 12:44:45.402846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.409489 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7455606 Nov 15 12:44:45.410332 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54222) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:45.415552 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:45.426374 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053b22a9-2c32-4999-aef1-13d0489d6354 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1b936b3f-b9b5-435b-a901-68378ac3fd55,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:45.492832 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-f8b618fa-5cc4-42a2-8bee-8bf39b27617f service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5171013 Nov 15 12:44:45.503007 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.673504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.678010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.684245 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd827542-97eb-446b-8c35-9b0c2c9e8d90 req-e8a07ed2-6ef1-4498-b85c-69e8e4d62ac4 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5260274 Nov 15 12:44:45.715249 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=846fee03-b265-4f76-af15-63247bdf8295,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:45.735514 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.736962 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3257415 Nov 15 12:44:45.738668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.739014 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.739349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.739687 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.740017 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.740391 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.740717 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.741042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.741363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.741713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.742041 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.742370 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9901e57a-ceb0-430d-ba5a-dbbb2b347c94 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:44:45.752400 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54228) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:45.776461 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:45.808861 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-102ea0d0-4616-4a9d-ba1c-268a5da372df req-cb5a722f-f702-48ae-8457-881f927514ef service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3035667 Nov 15 12:44:45.821461 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.securitygroups_db [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Project df44545940f44d95ad307aa0fea120c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:44:45.830451 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.971282 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:45.977863 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.011203 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8bb430e-3e69-471b-9688-74dd1b62cfce,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:46.024519 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.030609 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a735b6f8-399d-4798-b639-d7d0ef4e1eb5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2725701 Nov 15 12:44:46.031397 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54236) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:46.040403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'security_group_rule': {'security_group_id': 'c1bab170-a392-46e1-87bf-5ff04474b15e', 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:46.084843 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.securitygroups_db [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Project df44545940f44d95ad307aa0fea120c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:44:46.094096 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.177542 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.187681 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.213207 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f5778ec1-1d1f-4e91-be7b-7e526f7f5f59,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:46.232298 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.233598 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-bfbd584a-a552-4921-a693-c6ea367b9f8d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2003264 Nov 15 12:44:46.380798 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-ba3916d7-626a-4a88-89e9-ea770a076982 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-294809760&fields=id&tenant_id=df44545940f44d95ad307aa0fea120c4 HTTP/1.1" status: 200 len: 267 time: 0.0823898 Nov 15 12:44:46.479452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-579af101-4612-47dc-a28c-a90c0616d9cd tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:46.482596 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-579af101-4612-47dc-a28c-a90c0616d9cd tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0944183 Nov 15 12:44:46.512914 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'port': {'security_groups': ['7af163f1-64de-46c1-89ce-501c6047dc35', 'c1bab170-a392-46e1-87bf-5ff04474b15e']}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:44:46.547867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae702bd3-eba2-4f56-9dfe-92af3d7a8c3e req-2a0ac985-2242-4c43-87f6-c6031e398c82 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:46.550759 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ae702bd3-eba2-4f56-9dfe-92af3d7a8c3e req-2a0ac985-2242-4c43-87f6-c6031e398c82 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0955412 Nov 15 12:44:46.643625 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:46.649915 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ae702bd3-eba2-4f56-9dfe-92af3d7a8c3e req-eebaa7ae-827f-4959-a66e-5cbabd8bbb85 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870478 Nov 15 12:44:46.987566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:47.049656 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.059484 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.138365 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:47.155251 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:47.158496 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.159220 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-76f6c1dd-3422-4929-ac9b-7310bdc87a22 req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "PUT /v2.0/ports/66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 981 time: 0.6627986 Nov 15 12:44:47.159904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:47.164401 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14" -d '{"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:47.226501 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e89543-89f3-4e4c-9342-660ab1fd76d5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=6']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:47.249078 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50c86159-ca1c-42c4-b8ba-4f5b9ab73f87 x-openstack-request-id: req-50c86159-ca1c-42c4-b8ba-4f5b9ab73f87 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:47.251820 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:47.252535 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-50c86159-ca1c-42c4-b8ba-4f5b9ab73f87 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:47.253208 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:44:47.385630 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54272) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:47.490035 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec748ec6-63bf-43d8-a551-7a020a18df3f req-f72b2279-083a-4a83-99de-a14086f5b3f6 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:47.491946 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ec748ec6-63bf-43d8-a551-7a020a18df3f req-f72b2279-083a-4a83-99de-a14086f5b3f6 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.1812770 Nov 15 12:44:47.497859 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-db8abc00-a99e-4e32-9b6f-5c7e47c9fcdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:47.499719 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-db8abc00-a99e-4e32-9b6f-5c7e47c9fcdc service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1137 time: 0.1096272 Nov 15 12:44:47.534556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:47.561533 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-c6d3ad0a-083c-4451-a9f1-0801b372bc21 None None] Provisioning complete for port 66d80ca0-34c0-4ae9-a96c-a8004410e3af triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:44:47.562319 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c6d3ad0a-083c-4451-a9f1-0801b372bc21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.626489 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-daa1d2ae-059e-4702-b5f8-aaf963126260 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.819402 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ec748ec6-63bf-43d8-a551-7a020a18df3f req-5d5651c0-09ef-4693-9eab-2ef139d8079a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3117990 Nov 15 12:44:47.827431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-caccfaf3-e85b-4cf4-b5ce-9ec754e1fd01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:47.830272 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-caccfaf3-e85b-4cf4-b5ce-9ec754e1fd01 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.3112831 Nov 15 12:44:47.852835 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-daa1d2ae-059e-4702-b5f8-aaf963126260 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.871199 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-daa1d2ae-059e-4702-b5f8-aaf963126260 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:47.929686 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e7cdc08-4418-45b2-9805-948c2f20120c req-2fb3845e-40f7-4191-a7e9-4d9bbe0f70ba tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:47.942666 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3e7cdc08-4418-45b2-9805-948c2f20120c req-2fb3845e-40f7-4191-a7e9-4d9bbe0f70ba tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.1504257 Nov 15 12:44:47.986405 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa1d2ae-059e-4702-b5f8-aaf963126260 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cac615e-c516-47ac-af45-9c43a2636205,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:48.004944 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-daa1d2ae-059e-4702-b5f8-aaf963126260 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=1b48f6335bf749469d05c39a7fe9b7a8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6176939 Nov 15 12:44:48.009652 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54282) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:48.026255 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-7609b302-d66d-46b1-92dd-83cdfb4a9419 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 1000 time: 0.1580753 Nov 15 12:44:48.110170 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3e7cdc08-4418-45b2-9805-948c2f20120c req-16bbc471-5123-438e-90c8-494df8e3a0d9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1656218 Nov 15 12:44:48.111132 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-e6d2c77d-5954-4c56-a4b7-028b7f7c5708 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:48.112905 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-e6d2c77d-5954-4c56-a4b7-028b7f7c5708 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.0662794 Nov 15 12:44:48.156743 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.191974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.241966 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-a8c95f7b-f5e6-4c82-b951-b8bf01ce04dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:48.244700 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-a8c95f7b-f5e6-4c82-b951-b8bf01ce04dd service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1181610 Nov 15 12:44:48.291460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.296451 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.298804 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2cac615e-c516-47ac-af45-9c43a2636205 HTTP/1.1" status: 204 len: 168 time: 0.2878492 Nov 15 12:44:48.314360 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef14f68-4809-405e-a135-581081f64135 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cac615e-c516-47ac-af45-9c43a2636205,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:48.440371 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-21522c17-ae8d-429b-9e7f-a71b83e1a5be service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1697314 Nov 15 12:44:48.574094 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bf4e3c1f-3c1e-44ca-950c-5823a32c7c14 req-0eef9939-e46f-4b6a-9df9-86ae113213dd service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1201227 Nov 15 12:44:48.717433 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54290) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:48.741508 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4bbd6786-05e1-4d1c-849a-677b524559a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.871581 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4bbd6786-05e1-4d1c-849a-677b524559a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.876909 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4bbd6786-05e1-4d1c-849a-677b524559a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:48.940524 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4bbd6786-05e1-4d1c-849a-677b524559a4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=4849d86526f84341bc83b118189fb4a3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2212093 Nov 15 12:44:48.941888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bbd6786-05e1-4d1c-849a-677b524559a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eac00ec2-7d4c-4542-b5ee-1b04566c8e53,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:48.944571 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54292) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:49.032483 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:49.067435 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:49.130915 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:49.135559 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:49.137420 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/eac00ec2-7d4c-4542-b5ee-1b04566c8e53 HTTP/1.1" status: 204 len: 168 time: 0.1912086 Nov 15 12:44:49.148359 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6ce8c3-ccd0-4268-9349-56d51343810d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eac00ec2-7d4c-4542-b5ee-1b04566c8e53,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:49.295133 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b432846b-b82a-49f4-bcef-6d10cdbd883f req-a5f40911-b4da-447b-bb7d-5946d63bdc4f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:49.296931 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b432846b-b82a-49f4-bcef-6d10cdbd883f req-a5f40911-b4da-447b-bb7d-5946d63bdc4f tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0612350 Nov 15 12:44:49.373083 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b432846b-b82a-49f4-bcef-6d10cdbd883f req-e60912bc-664e-4905-86e8-353f942b210b tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683076 Nov 15 12:44:50.558833 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db92473f-85d2-45fa-a3a1-b5bf90bb4b84 req-079188cb-dc77-414e-921d-0997d4a7babb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:50.561043 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db92473f-85d2-45fa-a3a1-b5bf90bb4b84 req-079188cb-dc77-414e-921d-0997d4a7babb tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0710521 Nov 15 12:44:50.646298 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db92473f-85d2-45fa-a3a1-b5bf90bb4b84 req-befd0e5d-8f53-42ed-a8c7-fcbec648f244 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774496 Nov 15 12:44:51.822875 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c411a1-24a1-4ee9-bcdc-a7ec818ca117 req-4e146cfd-9997-4c4c-a97f-8dcf9b6b2838 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:51.829429 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-73c411a1-24a1-4ee9-bcdc-a7ec818ca117 req-4e146cfd-9997-4c4c-a97f-8dcf9b6b2838 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0701404 Nov 15 12:44:51.895405 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-73c411a1-24a1-4ee9-bcdc-a7ec818ca117 req-ed798f05-7742-45bc-9fd6-26c685c75b87 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634573 Nov 15 12:44:53.101329 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eadd8d8-bc7b-49ff-a261-920df4a05225 req-047449d8-b4b1-47ae-a7a2-4f987d461431 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:53.103784 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1eadd8d8-bc7b-49ff-a261-920df4a05225 req-047449d8-b4b1-47ae-a7a2-4f987d461431 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0935059 Nov 15 12:44:53.197101 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1eadd8d8-bc7b-49ff-a261-920df4a05225 req-7d111438-961c-48c7-bffa-70dd3ad933c9 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/security-groups?id=14a775be-d3a6-41f0-89a6-aa9e22446e2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810885 Nov 15 12:44:53.513477 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-357013ef-2bca-46f2-a940-8216e6832750 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:44:53.516438 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-357013ef-2bca-46f2-a940-8216e6832750 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 945 time: 0.0802732 Nov 15 12:44:53.675517 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Deleting port 08424d3d-6d1d-4f23-b097-340c6cd4f857 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:44:53.676247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:53.832072 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] For port 08424d3d-6d1d-4f23-b097-340c6cd4f857, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=08424d3d-6d1d-4f23-b097-340c6cd4f857,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:53.832948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:53.855619 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Calling delete_port for 08424d3d-6d1d-4f23-b097-340c6cd4f857 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:44:54.066682 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:54.108104 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Pushing event deleted for resources: {'Port': ['ID=08424d3d-6d1d-4f23-b097-340c6cd4f857,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:54.134990 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['08424d3d-6d1d-4f23-b097-340c6cd4f857'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:44:54.188591 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] No DVR routers for this DVR port 08424d3d-6d1d-4f23-b097-340c6cd4f857 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:44:54.192778 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:54.198396 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2fad95d3-f9cf-470d-a658-641fc5d94522 req-662cef4a-b8e8-4cc7-877a-fbd6ca8cd870 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.61 "DELETE /v2.0/ports/08424d3d-6d1d-4f23-b097-340c6cd4f857 HTTP/1.1" status: 204 len: 173 time: 0.6618469 Nov 15 12:44:54.199140 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'name': 'network-vif-deleted', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:44:54.203620 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8016fe2a-3e40-4f8b-acec-c60a80676b71" -d '{"events": [{"server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "name": "network-vif-deleted", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:44:54.273083 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:44:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4144248a-d809-42dc-8eaf-5c2974178fde x-openstack-request-id: req-4144248a-d809-42dc-8eaf-5c2974178fde {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:44:54.273560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "35af59c1-648d-4738-8273-1238b29f9a1b", "name": "network-vif-deleted", "tag": "08424d3d-6d1d-4f23-b097-340c6cd4f857", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:44:54.273962 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-4144248a-d809-42dc-8eaf-5c2974178fde {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:44:54.274647 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '35af59c1-648d-4738-8273-1238b29f9a1b', 'name': 'network-vif-deleted', 'tag': '08424d3d-6d1d-4f23-b097-340c6cd4f857', 'status': 'completed', 'code': 200} Nov 15 12:44:54.366494 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0dc3def1-29fb-4c71-8eac-c528b00e4508 req-d00ced4f-be94-48d6-994e-3c33d6659996 tempest-ServerRescueNegativeTestJSON-892087044 tempest-ServerRescueNegativeTestJSON-892087044-project] 10.222.0.44 "GET /v2.0/ports?device_id=35af59c1-648d-4738-8273-1238b29f9a1b HTTP/1.1" status: 200 len: 210 time: 0.0444276 Nov 15 12:44:55.452539 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54436) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:55.702217 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54444) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:55.876036 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b414d11b-13b4-4a89-bfa4-cd56bc47d284 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:55.995886 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b414d11b-13b4-4a89-bfa4-cd56bc47d284 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.002766 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b414d11b-13b4-4a89-bfa4-cd56bc47d284 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.054249 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b414d11b-13b4-4a89-bfa4-cd56bc47d284 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=70d16024b4344e8c948dc13789e3cff3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3508976 Nov 15 12:44:56.056548 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b414d11b-13b4-4a89-bfa4-cd56bc47d284 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7133784a-a3c4-4ae2-b555-c2425dbc5a06,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:56.060162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54450) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:56.122406 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.148101 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.208712 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.214004 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.216877 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7133784a-a3c4-4ae2-b555-c2425dbc5a06 HTTP/1.1" status: 204 len: 168 time: 0.1556122 Nov 15 12:44:56.229685 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e289b307-da99-4c7d-b07a-6750f12b9221 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7133784a-a3c4-4ae2-b555-c2425dbc5a06,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:56.429463 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.618071 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54456) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:56.632987 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab2f5b0d-8d1d-41ad-b022-76dcb609379c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.774328 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab2f5b0d-8d1d-41ad-b022-76dcb609379c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.782992 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ab2f5b0d-8d1d-41ad-b022-76dcb609379c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.826951 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-ab2f5b0d-8d1d-41ad-b022-76dcb609379c admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=c5f071e8c8bd4c7b817157eb27b3f4f9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2075710 Nov 15 12:44:56.827782 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab2f5b0d-8d1d-41ad-b022-76dcb609379c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d0aa622-3448-4273-8159-d10dee62b509,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:56.831750 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54460) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:56.865044 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Deleting port 1704d939-fa50-440a-83ed-bcfa8264fa57 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:44:56.866096 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.893251 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.934262 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.983488 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] For port 1704d939-fa50-440a-83ed-bcfa8264fa57, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1704d939-fa50-440a-83ed-bcfa8264fa57,segment=NetworkSegment(5488729b-f428-45a7-86f4-5ade62111aad),segment_id=5488729b-f428-45a7-86f4-5ade62111aad)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:56.984021 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:56.999013 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Calling delete_port for 1704d939-fa50-440a-83ed-bcfa8264fa57 owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:44:57.022294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.025169 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.026604 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6d0aa622-3448-4273-8159-d10dee62b509 HTTP/1.1" status: 204 len: 168 time: 0.1935141 Nov 15 12:44:57.036887 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2df4cc-357e-4fa0-84a5-1948b3c1eee6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d0aa622-3448-4273-8159-d10dee62b509,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:57.232222 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.266897 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Pushing event deleted for resources: {'Port': ['ID=1704d939-fa50-440a-83ed-bcfa8264fa57,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:57.478386 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.551796 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54470) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:57.578756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f22b1b73-89fa-43ce-a7c5-aa1e2be291c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.683822 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f22b1b73-89fa-43ce-a7c5-aa1e2be291c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.688959 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f22b1b73-89fa-43ce-a7c5-aa1e2be291c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.732222 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22b1b73-89fa-43ce-a7c5-aa1e2be291c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a97a3eb8-3d20-49cf-918d-e13d6d23ecb6,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:57.736585 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f22b1b73-89fa-43ce-a7c5-aa1e2be291c7 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=5f25fb38e8044840ab223f7bfed7116f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1795321 Nov 15 12:44:57.739210 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54472) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:57.811294 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Router 58cc1308-fc78-4246-a2a3-a75fe0220067 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:44:57.814314 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.829050 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.910658 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.915966 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:57.917877 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/a97a3eb8-3d20-49cf-918d-e13d6d23ecb6 HTTP/1.1" status: 204 len: 168 time: 0.1769702 Nov 15 12:44:57.936981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c43d790-df92-49cd-9eb6-75de1c34346a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a97a3eb8-3d20-49cf-918d-e13d6d23ecb6,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:57.953082 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:44:57.979396 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Sync routers for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:44:57.994281 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-57e5c505-35ab-4be3-bfb3-d65a90d5bd9b admin admin] 10.222.0.44 "PUT /v2.0/routers/58cc1308-fc78-4246-a2a3-a75fe0220067/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5386100 Nov 15 12:44:57.995796 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54480) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:58.003537 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:58.004576 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:58.133823 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks [] for router, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:58.154959 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:58.288525 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:58.360838 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Deleting port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:44:58.361432 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:58.423991 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53'}], 'enable_snat': True}, 'gw_port_id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:44:57Z', 'revision_number': 5, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port': {'id': 'd4ffc72f-ff7a-4b37-b3f5-431b95c220b2', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:da:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:37Z', 'updated_at': '2021-11-15T12:39:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:58.454258 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Checking router: 58cc1308-fc78-4246-a2a3-a75fe0220067 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:44:58.463232 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Routers {'58cc1308-fc78-4246-a2a3-a75fe0220067'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:44:58.463841 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['58cc1308-fc78-4246-a2a3-a75fe0220067'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:58.478361 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] For port d4ffc72f-ff7a-4b37-b3f5-431b95c220b2, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:44:58.478736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:58.497564 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Calling delete_port for d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 owned by network:router_gateway {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:44:58.600141 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] Set router 58cc1308-fc78-4246-a2a3-a75fe0220067 gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:44:58.667106 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:44:58Z', 'revision_number': 6, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:58.715733 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b945d3e0-5890-4998-9fd7-1d9dd3e78903 None None] The sync data for ids ['58cc1308-fc78-4246-a2a3-a75fe0220067'] in dv-cinder-803823-7-iscsi is: [{'id': '58cc1308-fc78-4246-a2a3-a75fe0220067', 'name': 'tempest-ServerRescueNegativeTestJSON-1419034450-router', 'tenant_id': '71e17179085148bfacb8d235fc6ee668', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:44:58Z', 'revision_number': 6, 'project_id': '71e17179085148bfacb8d235fc6ee668', 'gw_port_host': None}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:44:58.797113 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:58.824374 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Pushing event deleted for resources: {'Port': ['ID=d4ffc72f-ff7a-4b37-b3f5-431b95c220b2,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:59.152668 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.293593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.296095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.367124 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.367810 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 58cc1308-fc78-4246-a2a3-a75fe0220067 {{(pid=108286) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:44:59.376388 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.377595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-5a8cb455-13ff-4624-accd-6be5f2bf837d admin admin] 10.222.0.44 "DELETE /v2.0/routers/58cc1308-fc78-4246-a2a3-a75fe0220067 HTTP/1.1" status: 204 len: 168 time: 1.3804255 Nov 15 12:44:59.380201 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54508) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:59.443594 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Deleting subnet ac24af71-ce9d-47b2-a800-8b7fc2391e39 {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:44:59.448797 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.497030 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.570260 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 08424d3d-6d1d-4f23-b097-340c6cd4f857 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:44:59.580419 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.610951 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 08424d3d-6d1d-4f23-b097-340c6cd4f857 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:44:59.611883 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 08424d3d-6d1d-4f23-b097-340c6cd4f857 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:44:59.666933 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.701965 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac24af71-ce9d-47b2-a800-8b7fc2391e39,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:44:59.708631 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.712452 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-2bf0f801-5141-4a57-a36c-5f9c5aee7fc5 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/ac24af71-ce9d-47b2-a800-8b7fc2391e39 HTTP/1.1" status: 204 len: 168 time: 0.3311543 Nov 15 12:44:59.715669 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54516) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:44:59.821770 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.926197 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:44:59.958256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a1ca915-de15-4ccc-96e8-10f04d0723e3']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:59.981145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5488729b-f428-45a7-86f4-5ade62111aad') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:44:59.982381 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5488729b-f428-45a7-86f4-5ade62111aad') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:00.001606 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.028280 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.045776 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Releasing vlan 641 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:45:00.046734 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:45:00.050330 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:45:00.147040 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.155974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.162088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] 10.222.0.44 "DELETE /v2.0/networks/4a1ca915-de15-4ccc-96e8-10f04d0723e3 HTTP/1.1" status: 204 len: 168 time: 0.4451406 Nov 15 12:45:00.184885 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61e3bca-4628-4943-ae33-f25e65799084 admin admin] Pushing event deleted for resources: {'Network': ['ID=4a1ca915-de15-4ccc-96e8-10f04d0723e3,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:00.452633 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54542) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:00.509394 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f48c2874-8ea3-4933-8ec5-b71823b40706 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=71e17179085148bfacb8d235fc6ee668&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0529311 Nov 15 12:45:00.509847 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54546) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:00.588952 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.615066 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.697718 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1704d939-fa50-440a-83ed-bcfa8264fa57 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:45:00.702366 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.708061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:00.710358 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/14a775be-d3a6-41f0-89a6-aa9e22446e2e HTTP/1.1" status: 204 len: 168 time: 0.1990592 Nov 15 12:45:00.728185 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c6c1ee3-c637-4058-a4b4-8b6b3be0c901 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14a775be-d3a6-41f0-89a6-aa9e22446e2e,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:00.731938 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 1704d939-fa50-440a-83ed-bcfa8264fa57 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:45:00.732573 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1704d939-fa50-440a-83ed-bcfa8264fa57 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:45:00.733434 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:45:00.763228 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:45:00.763784 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device d4ffc72f-ff7a-4b37-b3f5-431b95c220b2 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:45:01.351533 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54582) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:01.614750 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c84685-36fc-4411-8898-347fffcc7d2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.734963 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c84685-36fc-4411-8898-347fffcc7d2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.744534 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f7c84685-36fc-4411-8898-347fffcc7d2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.799127 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f7c84685-36fc-4411-8898-347fffcc7d2a admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=dc6b00b584a541c48a54494e272331b7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4454873 Nov 15 12:45:01.800956 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54604) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:01.801527 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c84685-36fc-4411-8898-347fffcc7d2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2664b65c-86de-42e9-bdea-ba44686d109c,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:01.877955 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54606) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:01.888959 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.921255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.984415 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.987651 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:01.989298 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2664b65c-86de-42e9-bdea-ba44686d109c HTTP/1.1" status: 204 len: 168 time: 0.1855564 Nov 15 12:45:02.004415 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015e32cd-1eb5-4cbf-b3cd-ad5dfa45ac70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2664b65c-86de-42e9-bdea-ba44686d109c,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.041737 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-745749199-network', 'tenant_id': '36f242c4967546e1b9d3186179668c38'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:02.070742 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Made reservation on behalf of 36f242c4967546e1b9d3186179668c38 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:45:02.073606 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.084543 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.201248 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.212279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.248694 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] vlan segment allocate from pool success with {'vlan_id': 603, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:45:02.251612 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c0119d2-ff04-4963-a912-5b30aeee920c,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.266650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.266909 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Added segment 6b28e91b-fc67-429b-a574-ffea38211fc9 of type vlan for network d674a754-ca11-4d5c-be9e-426d0c193bcb Nov 15 12:45:02.314093 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.347867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.349501 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:02.350358 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.418637 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54616) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:02.435941 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5564175 Nov 15 12:45:02.441549 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54618) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:02.445953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f313c5b2-2f80-4ecf-9558-eaba1ef401e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.461491 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Request body: {'subnet': {'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-745749199-subnet', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:02.476885 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad70cdc-92c6-4110-a07e-2cabe7d1bdf0 admin admin] Pushing event updated for resources: {'Network': ['ID=d674a754-ca11-4d5c-be9e-426d0c193bcb,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.498071 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network d674a754-ca11-4d5c-be9e-426d0c193bcb details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:45:02.503518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Made reservation on behalf of 36f242c4967546e1b9d3186179668c38 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:45:02.507405 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.616984 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f313c5b2-2f80-4ecf-9558-eaba1ef401e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.622682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f313c5b2-2f80-4ecf-9558-eaba1ef401e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.674120 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f313c5b2-2f80-4ecf-9558-eaba1ef401e4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=c357bb204a0647909708778917648df7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2537782 Nov 15 12:45:02.678537 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54622) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:02.684783 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f313c5b2-2f80-4ecf-9558-eaba1ef401e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0fdadb1-e6a3-4fb7-b13f-b722e8bda6b2,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.760595 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.764413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.801875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.830061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Pushing event updated for resources: {'Subnet': ['ID=925098dd-312e-4533-8590-2a9da45326c8,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.857741 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Checking segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:45:02.858218 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Network hostable DHCP agents. Network: d674a754-ca11-4d5c-be9e-426d0c193bcb, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:45:02.881578 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:45:02.881836 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.884248 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.885426 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/c0fdadb1-e6a3-4fb7-b13f-b722e8bda6b2 HTTP/1.1" status: 204 len: 168 time: 0.2059751 Nov 15 12:45:02.897029 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, d674a754-ca11-4d5c-be9e-426d0c193bcb) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:02.899625 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43365147-2364-4a75-81de-eb1162c30c43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0fdadb1-e6a3-4fb7-b13f-b722e8bda6b2,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:02.904495 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:02.905306 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.927796 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-59c8865e-8ca9-470a-8b6f-60511832dacb admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4839232 Nov 15 12:45:02.932704 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54626) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:02.934587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b494c659-4177-4a72-a112-59a95e0ed0e9 None None] Network d674a754-ca11-4d5c-be9e-426d0c193bcb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:45:02.946768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:02.991100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:02.993315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.076265 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.151966 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-d674a754-ca11-4d5c-be9e-426d0c193bcb', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:45:03.153476 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.294600 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.320395 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Allocated IP 172.20.0.2 (d674a754-ca11-4d5c-be9e-426d0c193bcb/925098dd-312e-4533-8590-2a9da45326c8/cff413bf-df61-4075-a7de-1561fe636ca9) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:45:03.368146 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-455baf5c-eed5-42bd-8b0b-8038308e5adf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.599897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.610985 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.612271 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.642137 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.688093 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:03.708522 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:03.712908 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Pushing event updated for resources: {'Port': ['ID=cff413bf-df61-4075-a7de-1561fe636ca9,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:03.716636 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:45:03.798619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Attempting to bind port cff413bf-df61-4075-a7de-1561fe636ca9 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:45:03.798619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Attempting to bind port cff413bf-df61-4075-a7de-1561fe636ca9 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:45:03.798619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Attempting to bind port cff413bf-df61-4075-a7de-1561fe636ca9 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:45:03.805936 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 44, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:45:03.805936 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Checking segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:45:03.806741 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.806741 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Bound using segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:45:03.807160 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Bound port: cff413bf-df61-4075-a7de-1561fe636ca9, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:45:03.807446 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.826765 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Allocated IP 172.27.0.13 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/cd39133e-d1b0-409f-a75a-36f18f64e1b8) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:45:03.895252 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] For port cff413bf-df61-4075-a7de-1561fe636ca9, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:45:03.900698 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] For port cff413bf-df61-4075-a7de-1561fe636ca9, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cff413bf-df61-4075-a7de-1561fe636ca9,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:45:03.908092 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.996665 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:03.997798 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93bd927-fcee-465f-b4c2-6dbeaa46a7cb None None] Pushing event updated for resources: {'Port': ['ID=cff413bf-df61-4075-a7de-1561fe636ca9,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:04.060996 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:04.104231 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:04.111337 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:04.115281 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:45:04.144971 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Pushing event updated for resources: {'Port': ['ID=cd39133e-d1b0-409f-a75a-36f18f64e1b8,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:04.500954 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:04.767026 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cff413bf-df61-4075-a7de-1561fe636ca9 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:04.821974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:04.874489 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port cff413bf-df61-4075-a7de-1561fe636ca9 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:04.875117 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:04.998275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:45:05.033520 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:05.088190 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port cff413bf-df61-4075-a7de-1561fe636ca9, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cff413bf-df61-4075-a7de-1561fe636ca9,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:05.094016 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:05.149071 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:45:05.160742 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=cff413bf-df61-4075-a7de-1561fe636ca9,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:05.165259 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:45:05.183416 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:05.184635 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:44:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:05.192157 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:05.193655 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-672855e8-9496-490f-b0d6-26dcca05c5da admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.2580862 Nov 15 12:45:05.196970 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54672) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:05.362503 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:05.370276 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05f06aa2-61bc-412e-bef4-c5b6c562cd35 None None] Network d674a754-ca11-4d5c-be9e-426d0c193bcb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:45:05.565200 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e1aae131-ebea-40ed-b501-11818bd006f8 None None] Provisioning complete for port cff413bf-df61-4075-a7de-1561fe636ca9 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:05.565559 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e1aae131-ebea-40ed-b501-11818bd006f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:05.854093 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:05.991896 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1ab2b2be-1c71-426f-8914-37fa7eaa3e94 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.079128 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:04Z', 'revision_number': 3, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:06.123490 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:45:06.123942 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Updating router 807671ef-c6a8-4ec7-a17f-112ed19c0baa port cd39133e-d1b0-409f-a75a-36f18f64e1b8 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:45:06.165936 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.463937 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-bc38ea74-4368-4995-80ce-294535bc2d6c None None] Provisioning complete for port cff413bf-df61-4075-a7de-1561fe636ca9 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:06.464430 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bc38ea74-4368-4995-80ce-294535bc2d6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.466265 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Allocated IP 172.20.0.1 (d674a754-ca11-4d5c-be9e-426d0c193bcb/925098dd-312e-4533-8590-2a9da45326c8/65376b5d-20e9-4d73-898c-67d942f03649) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:45:06.483357 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54714) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:06.635311 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.646345 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.713901 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6323266d-655b-4d50-87b7-fe5ba5b1b664 None None] Pushing event updated for resources: {'Port': ['ID=cd39133e-d1b0-409f-a75a-36f18f64e1b8,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:06.716825 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Attempting to bind port cd39133e-d1b0-409f-a75a-36f18f64e1b8 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:45:06.717226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Attempting to bind port cd39133e-d1b0-409f-a75a-36f18f64e1b8 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:45:06.717588 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Attempting to bind port cd39133e-d1b0-409f-a75a-36f18f64e1b8 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:45:06.724238 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 44, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:45:06.724623 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:45:06.725033 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.725423 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:45:06.725892 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Bound port: cd39133e-d1b0-409f-a75a-36f18f64e1b8, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:45:06.726274 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.749113 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cff413bf-df61-4075-a7de-1561fe636ca9 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:06.763766 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.832869 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] For port cd39133e-d1b0-409f-a75a-36f18f64e1b8, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:45:06.837482 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] For port cd39133e-d1b0-409f-a75a-36f18f64e1b8, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cd39133e-d1b0-409f-a75a-36f18f64e1b8,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:45:06.844945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ca5ac81-9bac-4fc0-b046-dca3c253b562 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.851594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.909597 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.942928 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port cff413bf-df61-4075-a7de-1561fe636ca9 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:06.943443 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.945291 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:06.978337 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:06.992454 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:06.995035 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:45:07.004326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Pushing event updated for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:07.005660 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6323266d-655b-4d50-87b7-fe5ba5b1b664 None None] Pushing event updated for resources: {'Port': ['ID=cd39133e-d1b0-409f-a75a-36f18f64e1b8,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:07.010745 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:07.010745 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:45:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:07.070759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ca5ac81-9bac-4fc0-b046-dca3c253b562 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.072561 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.077852 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5ca5ac81-9bac-4fc0-b046-dca3c253b562 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.200634 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5ca5ac81-9bac-4fc0-b046-dca3c253b562 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=5352d58b426e40c4979cd3c69b831f03&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7162712 Nov 15 12:45:07.205515 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54732) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:07.208112 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca5ac81-9bac-4fc0-b046-dca3c253b562 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7367efde-81e4-417f-a8d6-a171994d6353,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:07.247173 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:07.342499 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.367913 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.376374 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.405066 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0dc3d669-8e9c-47c6-9621-b4e04fb9dcfa None None] Provisioning complete for port 65376b5d-20e9-4d73-898c-67d942f03649 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:07.405870 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0dc3d669-8e9c-47c6-9621-b4e04fb9dcfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.463884 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.469413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.471393 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7367efde-81e4-417f-a8d6-a171994d6353 HTTP/1.1" status: 204 len: 168 time: 0.2595172 Nov 15 12:45:07.481264 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0dc3d669-8e9c-47c6-9621-b4e04fb9dcfa None None] Port 65376b5d-20e9-4d73-898c-67d942f03649 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:45:07.489140 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0db2be0-0775-4be1-8573-51a299df9f8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7367efde-81e4-417f-a8d6-a171994d6353,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:07.634226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:04Z', 'revision_number': 3, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:07.667965 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.681116 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.686336 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b25417f2-184e-4cd8-92a4-9d9dd8ec07fc None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:04Z', 'revision_number': 3, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:45:07.811397 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:07.816757 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Pushing event updated for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:07.974811 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54744) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:08.019028 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:08.019258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-afc903da-3aae-4596-9777-608d943bc0c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.021494 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:08.204295 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-afc903da-3aae-4596-9777-608d943bc0c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.205821 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:45:08.229479 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-afc903da-3aae-4596-9777-608d943bc0c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.260531 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afc903da-3aae-4596-9777-608d943bc0c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f6913c7-ab86-428f-9698-8256e18033b2,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:08.309192 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-afc903da-3aae-4596-9777-608d943bc0c9 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=797159136712476baabb3369c2b273db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3270006 Nov 15 12:45:08.310274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54750) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:08.370899 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.390840 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.418859 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:45:08.426908 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-608aef0e-bc91-496e-af87-2d63c8942f7d admin admin] 10.222.0.44 "PUT /v2.0/routers/807671ef-c6a8-4ec7-a17f-112ed19c0baa/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2285984 Nov 15 12:45:08.438099 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.446350 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-29064ed0-13ff-4a6d-8eae-cbbb27f59122 None None] Provisioning complete for port 65376b5d-20e9-4d73-898c-67d942f03649 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:08.446973 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-29064ed0-13ff-4a6d-8eae-cbbb27f59122 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.526142 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.529150 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.533457 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2f6913c7-ab86-428f-9698-8256e18033b2 HTTP/1.1" status: 204 len: 168 time: 0.2183983 Nov 15 12:45:08.552775 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-29064ed0-13ff-4a6d-8eae-cbbb27f59122 None None] Port 65376b5d-20e9-4d73-898c-67d942f03649 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:45:08.556377 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100fb89a-f71f-4fd0-98d7-4e4da30ec7f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f6913c7-ab86-428f-9698-8256e18033b2,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:08.756447 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cd39133e-d1b0-409f-a75a-36f18f64e1b8 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:08.858425 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port cd39133e-d1b0-409f-a75a-36f18f64e1b8 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:08.858967 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:08.970164 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.015291 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port cd39133e-d1b0-409f-a75a-36f18f64e1b8, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cd39133e-d1b0-409f-a75a-36f18f64e1b8,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:09.027281 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.144931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=cd39133e-d1b0-409f-a75a-36f18f64e1b8,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:09.157677 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.380458 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54778) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:09.385888 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group': {'name': 'tempest-securitygroup--848616379', 'description': 'tempest-description--2133751861'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:09.421274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.546168 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.554272 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.597873 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.599306 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2172658 Nov 15 12:45:09.603684 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54786) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:09.604530 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5484e46-5c17-47d6-942b-73336bfe5c5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf1466de-656b-4213-a69b-ba18bc969d25,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:09.614697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group_rule': {'security_group_id': 'bf1466de-656b-4213-a69b-ba18bc969d25', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:09.658417 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.735666 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.741446 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.763357 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9e767a8-42aa-45e8-a485-f79f8a821da5,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:09.778400 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.783086 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-397e20a4-899b-43be-9956-094367944360 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1761982 Nov 15 12:45:09.786242 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54792) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:09.796540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group_rule': {'security_group_id': 'bf1466de-656b-4213-a69b-ba18bc969d25', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:09.839460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.928861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.933494 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.950609 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c113f5f2-4d99-4d44-be69-76313ca1bc10,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:09.963993 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:09.970191 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-82dca6a2-1427-41b0-9886-efe01076859b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1764529 Nov 15 12:45:09.970715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 54798) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:09.978522 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:10.017296 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.018481 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:45:10.045444 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:10.047985 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:45:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:10.157618 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.198268 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:10.325174 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Allocated IP 172.27.0.80 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/84eec597-2a6c-441f-8978-86b5b3b35393) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:45:10.496891 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.510588 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54814) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:10.536595 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 2, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:10.553832 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.587056 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:45:10.588094 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Updating router 807671ef-c6a8-4ec7-a17f-112ed19c0baa port 65376b5d-20e9-4d73-898c-67d942f03649 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:45:10.614118 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:10.622185 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:10.631663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:45:10.636926 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.750746 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.781535 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bbbeb925-786d-4046-b865-cfaa20517b1f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.817698 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.823184 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cd39133e-d1b0-409f-a75a-36f18f64e1b8 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:10.930572 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=84eec597-2a6c-441f-8978-86b5b3b35393,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:10.941214 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port cd39133e-d1b0-409f-a75a-36f18f64e1b8 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:10.941602 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.962984 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bbbeb925-786d-4046-b865-cfaa20517b1f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:10.975023 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bbbeb925-786d-4046-b865-cfaa20517b1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.028364 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbeb925-786d-4046-b865-cfaa20517b1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6489002f-ef59-4cd1-81b5-01dbe55be01b,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:11.044635 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-bbbeb925-786d-4046-b865-cfaa20517b1f admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=03f13165e5ab4947be9c9983c2e82edf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5320766 Nov 15 12:45:11.048884 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 54822) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:11.134320 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.134617 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.144243 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.167522 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.251560 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=84eec597-2a6c-441f-8978-86b5b3b35393,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:11.267940 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.270507 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.271261 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.276011 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.278158 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/6489002f-ef59-4cd1-81b5-01dbe55be01b HTTP/1.1" status: 204 len: 168 time: 0.2280777 Nov 15 12:45:11.280327 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.293953 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf89321-9f16-4217-bd3d-02c7a54d48e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6489002f-ef59-4cd1-81b5-01dbe55be01b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:11.298479 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.310205 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1db2193f-22a1-4bde-8abe-18120b9299f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3273895 Nov 15 12:45:11.371988 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Pushing event updated for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:11.396788 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.397321 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.397801 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.398280 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.398766 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.399320 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.399883 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.400321 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.401131 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.401554 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.401992 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.402327 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:11.478879 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Attempting to bind port 65376b5d-20e9-4d73-898c-67d942f03649 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:45:11.479319 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Attempting to bind port 65376b5d-20e9-4d73-898c-67d942f03649 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:45:11.479817 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Attempting to bind port 65376b5d-20e9-4d73-898c-67d942f03649 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:45:11.492483 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 45, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:45:11.492689 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Checking segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:45:11.493017 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.494387 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Bound using segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:45:11.498865 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Bound port: 65376b5d-20e9-4d73-898c-67d942f03649, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:45:11.500219 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.614385 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] For port 65376b5d-20e9-4d73-898c-67d942f03649, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:45:11.620079 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] For port 65376b5d-20e9-4d73-898c-67d942f03649, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=65376b5d-20e9-4d73-898c-67d942f03649,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:45:11.627930 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.728996 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-027d99cb-381f-4390-8694-d361e396b779 None None] Provisioning complete for port 65376b5d-20e9-4d73-898c-67d942f03649 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:11.730279 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-027d99cb-381f-4390-8694-d361e396b779 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:11.743654 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:11.744719 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:45:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:11.769440 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-b5d97a99-88d2-43eb-a1fd-8e2174d61f51 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-securitygroup--848616379&fields=id&tenant_id=36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 267 time: 0.1325355 Nov 15 12:45:11.839648 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08010b8-792c-4d33-a595-6ec3c796ec9c None None] Pushing event updated for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=4']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:11.928391 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-027d99cb-381f-4390-8694-d361e396b779 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:12.010182 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-027d99cb-381f-4390-8694-d361e396b779 None None] For port 65376b5d-20e9-4d73-898c-67d942f03649, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=65376b5d-20e9-4d73-898c-67d942f03649,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:12.016870 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-027d99cb-381f-4390-8694-d361e396b779 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:12.038459 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:12.060894 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-18262510-1227-4446-9243-6c4059b1b260 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:12.064092 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-18262510-1227-4446-9243-6c4059b1b260 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 810 time: 0.2869670 Nov 15 12:45:12.091219 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027d99cb-381f-4390-8694-d361e396b779 None None] Pushing event updated for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:12.091710 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-eb9e1a0d-d861-4eb5-8e8a-cd20c590890c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/quotas/36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 375 time: 0.0191591 Nov 15 12:45:12.147415 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-3ebe85f2-3f06-4a8f-85a3-d3b20b6b6bb3 None None] Provisioning complete for port 65376b5d-20e9-4d73-898c-67d942f03649 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:12.148383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85f2-3f06-4a8f-85a3-d3b20b6b6bb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:12.187981 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-6b41de17-3b49-485b-8447-1a3b17fd5956 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0783882 Nov 15 12:45:12.390686 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:12.444700 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca662076-6134-447d-a63e-7ab27589b750 None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:45:12.552636 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-7760bee9-b4c6-406c-8ca9-bdb98af234b2 service neutron] 10.222.0.44 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3437183 Nov 15 12:45:12.717980 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-eb504bc0-195a-4021-967e-fff2926665d2 service neutron] 10.222.0.44 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434290 Nov 15 12:45:12.774078 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 65376b5d-20e9-4d73-898c-67d942f03649 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:12.809255 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:45:12.849637 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 65376b5d-20e9-4d73-898c-67d942f03649 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:12.850083 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:13.237057 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eebf08c6-bae0-4d2d-89ac-7b993f81f67a req-84b1083e-2ea5-427e-b293-faad0fb00e03 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 210 time: 0.0739875 Nov 15 12:45:13.493190 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8377fd91-1af9-4566-9590-a49ac1205358 req-4d2ad900-ba5c-482e-a4c1-b9644e31538d tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:13.496473 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8377fd91-1af9-4566-9590-a49ac1205358 req-4d2ad900-ba5c-482e-a4c1-b9644e31538d tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.1084001 Nov 15 12:45:13.630793 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8377fd91-1af9-4566-9590-a49ac1205358 req-5e9d3936-8fef-4b72-b3ac-408e8a401b58 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255519 Nov 15 12:45:14.105045 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:14.415130 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee4480a7-d24e-4635-812b-983432882815 req-17450f44-16ca-493b-827a-14b57a26c5cb tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 210 time: 0.0560524 Nov 15 12:45:14.788957 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518585ef-9a0a-4f01-80c6-265d4307d220 req-ad16924d-bee2-4273-9862-01550caf5892 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:14.790714 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-518585ef-9a0a-4f01-80c6-265d4307d220 req-ad16924d-bee2-4273-9862-01550caf5892 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.0588090 Nov 15 12:45:14.847124 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-518585ef-9a0a-4f01-80c6-265d4307d220 req-e3a53e73-7a66-413b-b7d1-0ffc5b8903fe tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490577 Nov 15 12:45:15.509062 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-30d81f40-5a9a-4cbd-acd8-06e7a7dbd633 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:15.511015 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-30d81f40-5a9a-4cbd-acd8-06e7a7dbd633 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 810 time: 0.1944201 Nov 15 12:45:15.560525 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee102306-7c4b-4c86-a543-6c3354e4cdde req-6b2accd1-ff2e-4cbb-b530-5b46353c37f5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 210 time: 0.0443373 Nov 15 12:45:15.628341 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-53b94ce9-9c36-4a64-b1e9-6a174e946673 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 379 time: 0.0799663 Nov 15 12:45:15.646640 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'port': {'device_id': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'admin_state_up': True, 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'security_groups': ['bf1466de-656b-4213-a69b-ba18bc969d25']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:15.780614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Made reservation on behalf of 36f242c4967546e1b9d3186179668c38 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:45:15.785389 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:15.986847 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Allocated IP 172.20.0.14 (d674a754-ca11-4d5c-be9e-426d0c193bcb/925098dd-312e-4533-8590-2a9da45326c8/2074d291-306a-482f-9039-58a67e582e39) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:45:16.008221 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638c76c8-4d98-4600-bcfa-9f0b1516a976 req-2caf9aef-592f-4a2b-9a98-e3ba4772562a tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:16.011216 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-638c76c8-4d98-4600-bcfa-9f0b1516a976 req-2caf9aef-592f-4a2b-9a98-e3ba4772562a tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.0727768 Nov 15 12:45:16.081466 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-638c76c8-4d98-4600-bcfa-9f0b1516a976 req-30ef102f-41db-41f4-a052-39cefd8ecbe1 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614910 Nov 15 12:45:16.168753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:16.210601 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:16.261231 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:45:16.264676 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:45:16.269475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:45:16.302237 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:16.350274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:16.351115 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:16.389560 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-03d05bc1-0592-433d-bae1-440dc30f6328 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7502668 Nov 15 12:45:16.569878 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-66a08b04-1219-4f36-baf3-c24acb5dde21 None None] Provisioning complete for port 2074d291-306a-482f-9039-58a67e582e39 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:16.570668 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-66a08b04-1219-4f36-baf3-c24acb5dde21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:16.621534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-66a08b04-1219-4f36-baf3-c24acb5dde21 None None] Port 2074d291-306a-482f-9039-58a67e582e39 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:45:16.639208 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Request body: {'port': {'device_id': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:16.740598 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:16.861517 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc288b3-090c-41cc-b08e-1a5ceb904a85 req-5672382a-e8e7-46a0-af3d-a98cc114f019 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:16.863028 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bfc288b3-090c-41cc-b08e-1a5ceb904a85 req-5672382a-e8e7-46a0-af3d-a98cc114f019 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 932 time: 0.1424222 Nov 15 12:45:16.879096 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-50089727-7729-496c-920a-a37a1e94e7fd tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:16.880694 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-50089727-7729-496c-920a-a37a1e94e7fd tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.1351619 Nov 15 12:45:17.082909 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bfc288b3-090c-41cc-b08e-1a5ceb904a85 req-5786e8c1-5a2f-4267-ae23-f1386537d860 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1617529 Nov 15 12:45:17.175398 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Deleting port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:45:17.175736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.255099 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e25b27a-5b86-478b-a598-9b73c75245e5 req-31abac9d-6bfe-4845-ab1f-f069aa9a5056 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:17.256832 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e25b27a-5b86-478b-a598-9b73c75245e5 req-31abac9d-6bfe-4845-ab1f-f069aa9a5056 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 945 time: 0.0692048 Nov 15 12:45:17.333268 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2074d291-306a-482f-9039-58a67e582e39 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:45:17.349042 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6e25b27a-5b86-478b-a598-9b73c75245e5 req-47966cbd-7b11-4749-873d-3d552b6480ff tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/security-groups?id=e0b880aa-7531-4afc-b2bc-0811ae872683&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808330 Nov 15 12:45:17.352598 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.364167 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] For port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,segment=NetworkSegment(eec395e4-864f-4540-8982-74f84a015989),segment_id=eec395e4-864f-4540-8982-74f84a015989)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:17.364630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.382463 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Transition to ACTIVE for port object 2074d291-306a-482f-9039-58a67e582e39 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:45:17.383126 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Calling delete_port for 5e8018cc-22f9-4ebf-831d-0d200a7dac1d owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:45:17.392209 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.502410 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Pushing event updated for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:17.656579 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.672732 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Attempting to bind port 2074d291-306a-482f-9039-58a67e582e39 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:45:17.673061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Attempting to bind port 2074d291-306a-482f-9039-58a67e582e39 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:45:17.673396 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Attempting to bind port 2074d291-306a-482f-9039-58a67e582e39 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:45:17.699425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Pushing event deleted for resources: {'Port': ['ID=5e8018cc-22f9-4ebf-831d-0d200a7dac1d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:17.709974 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['5e8018cc-22f9-4ebf-831d-0d200a7dac1d'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:45:17.712335 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Port 2074d291-306a-482f-9039-58a67e582e39 on network d674a754-ca11-4d5c-be9e-426d0c193bcb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:45:17.712664 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Attempting to bind port 2074d291-306a-482f-9039-58a67e582e39 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:45:17.752352 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] No DVR routers for this DVR port 5e8018cc-22f9-4ebf-831d-0d200a7dac1d on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:45:17.755213 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.758589 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-76c264eb-976b-47d3-888f-0f045d5c35ff req-691df817-902d-4fcc-a20c-76ab5d53ab13 tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.61 "DELETE /v2.0/ports/5e8018cc-22f9-4ebf-831d-0d200a7dac1d HTTP/1.1" status: 204 len: 173 time: 0.8350475 Nov 15 12:45:17.759352 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'name': 'network-vif-deleted', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:45:17.763668 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1498db4-fd3e-4b6d-9512-4df0dbaf783e" -d '{"events": [{"server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "name": "network-vif-deleted", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:45:17.769376 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 45, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:45:17.770009 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Checking segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:45:17.771114 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Bound using segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:45:17.771898 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Bound port: 2074d291-306a-482f-9039-58a67e582e39, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:45:17.772736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.896556 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:45:17.904880 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=2074d291-306a-482f-9039-58a67e582e39,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:45:17.913924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.959609 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:17.960636 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:17.962772 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] 10.222.0.61 "PUT /v2.0/ports/2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 1094 time: 1.5106947 Nov 15 12:45:18.014800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba2025c-e232-48e2-ab38-150ea1a120ea service neutron] Pushing event updated for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:18.045566 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:45:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6680d427-8f3a-4362-b66b-8db0166b597e x-openstack-request-id: req-6680d427-8f3a-4362-b66b-8db0166b597e {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:45:18.045926 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd3c5be8-9a18-4724-bfa1-0e0fe8313b90", "name": "network-vif-deleted", "tag": "5e8018cc-22f9-4ebf-831d-0d200a7dac1d", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:45:18.046263 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6680d427-8f3a-4362-b66b-8db0166b597e {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:45:18.047264 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3c5be8-9a18-4724-bfa1-0e0fe8313b90', 'name': 'network-vif-deleted', 'tag': '5e8018cc-22f9-4ebf-831d-0d200a7dac1d', 'status': 'completed', 'code': 200} Nov 15 12:45:18.151921 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-beeb9956-5c40-4c39-b2c4-b990c48f5dbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:18.153811 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-beeb9956-5c40-4c39-b2c4-b990c48f5dbb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1097 time: 0.0778115 Nov 15 12:45:18.228750 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-5ea0cec4-e877-4aa5-839b-b4b89bbc7168 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 217 time: 0.0513828 Nov 15 12:45:18.299632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63eca40-cfbe-48fc-808f-4befb47878ec req-eda7ab6e-675d-47df-8ab1-b738f3d0844c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:18.302825 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c63eca40-cfbe-48fc-808f-4befb47878ec req-eda7ab6e-675d-47df-8ab1-b738f3d0844c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 944 time: 0.0734687 Nov 15 12:45:18.328938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-ed549488-f2ac-47df-95da-d04f001bac33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:18.332331 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-ed549488-f2ac-47df-95da-d04f001bac33 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0878639 Nov 15 12:45:18.382340 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c63eca40-cfbe-48fc-808f-4befb47878ec req-67cc3b99-1948-4a07-94ed-476b3e840d79 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0682595 Nov 15 12:45:18.400223 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-3b206cd8-0560-479d-bef0-e816b66a75ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:18.401895 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-3b206cd8-0560-479d-bef0-e816b66a75ff service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0583916 Nov 15 12:45:18.508788 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-07f1ba2c-d0e7-48a9-8c2e-451aeaa1378e req-7075dd8f-5b71-4b6e-abf5-81c3e484348a tempest-VolumesSnapshotTestJSON-1682918741 tempest-VolumesSnapshotTestJSON-1682918741-project] 10.222.0.44 "GET /v2.0/ports?device_id=bd3c5be8-9a18-4724-bfa1-0e0fe8313b90 HTTP/1.1" status: 200 len: 210 time: 0.0376368 Nov 15 12:45:18.561286 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-0f205585-141a-4fc9-8839-ce98155f86bf service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449430 Nov 15 12:45:18.702968 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-de6a8bec-49fe-4bff-b4bd-fd4bcc142498 req-90ea6956-4262-4b4d-95ea-7f0facaca615 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323125 Nov 15 12:45:19.296514 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55024) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:19.449279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0501760e-a237-40ba-a1c9-140131da9fbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.571018 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0501760e-a237-40ba-a1c9-140131da9fbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.576918 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0501760e-a237-40ba-a1c9-140131da9fbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.578550 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0991edf-11bb-40ba-932f-f78b90ee5970 req-b887b586-b365-4a1b-8aa9-68aa6f10610e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:19.581235 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c0991edf-11bb-40ba-932f-f78b90ee5970 req-b887b586-b365-4a1b-8aa9-68aa6f10610e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 944 time: 0.0966110 Nov 15 12:45:19.618730 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5e8018cc-22f9-4ebf-831d-0d200a7dac1d no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:45:19.632914 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0501760e-a237-40ba-a1c9-140131da9fbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f86165b8-aca7-4e1b-a3a3-a4a02a7d285d,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:19.639181 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0501760e-a237-40ba-a1c9-140131da9fbc admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=587b3397cbe34f37840b590953cec8f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3426156 Nov 15 12:45:19.642853 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55034) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:19.664722 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 5e8018cc-22f9-4ebf-831d-0d200a7dac1d {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:45:19.665239 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 5e8018cc-22f9-4ebf-831d-0d200a7dac1d not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:45:19.688420 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c0991edf-11bb-40ba-932f-f78b90ee5970 req-d0e7941b-b37a-47c6-b8f3-5c1b6200184c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0988476 Nov 15 12:45:19.735812 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.762024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.815020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.817941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:19.819617 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f86165b8-aca7-4e1b-a3a3-a4a02a7d285d HTTP/1.1" status: 204 len: 168 time: 0.1750538 Nov 15 12:45:19.835678 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd88497-8fb2-4f48-ae24-b08cff9d9234 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f86165b8-aca7-4e1b-a3a3-a4a02a7d285d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:20.050743 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'tag': '2074d291-306a-482f-9039-58a67e582e39'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:45:20.054639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8ddce23-f54a-4451-9196-8246e0c02099" -d '{"events": [{"name": "network-changed", "server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "tag": "2074d291-306a-482f-9039-58a67e582e39"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:45:20.101950 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:45:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5900abe-7928-4cad-885f-9cd2682510ea x-openstack-request-id: req-d5900abe-7928-4cad-885f-9cd2682510ea {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:45:20.102556 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "tag": "2074d291-306a-482f-9039-58a67e582e39", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:45:20.102977 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-d5900abe-7928-4cad-885f-9cd2682510ea {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:45:20.103754 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'tag': '2074d291-306a-482f-9039-58a67e582e39', 'status': 'completed', 'code': 200} Nov 15 12:45:20.218861 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-2fd04ba6-0a07-482c-b1a7-9e47170d06be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:20.220647 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-2fd04ba6-0a07-482c-b1a7-9e47170d06be service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1097 time: 0.0583193 Nov 15 12:45:20.351087 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-619924fe-9ab2-4d53-a8aa-3887a0e7d76e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:20.353645 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-619924fe-9ab2-4d53-a8aa-3887a0e7d76e service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1199768 Nov 15 12:45:20.404030 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-63d5d63f-7307-4bd1-aa7d-4082e03e77ff service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 217 time: 0.0364411 Nov 15 12:45:20.473021 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-66f1c33b-f20b-4ce3-a7bc-c0256f951ca7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:20.475532 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-66f1c33b-f20b-4ce3-a7bc-c0256f951ca7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0602009 Nov 15 12:45:20.540541 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-5b2f4826-8554-4d6b-90fb-fc19dc6e9a2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:20.542255 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-5b2f4826-8554-4d6b-90fb-fc19dc6e9a2c service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0570309 Nov 15 12:45:20.669224 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-e1a70251-ecdc-4cb7-8378-e2b59ce7e063 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1164110 Nov 15 12:45:20.794538 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d8ddce23-f54a-4451-9196-8246e0c02099 req-0c67f301-a996-4559-a448-7c1955429bef service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1107149 Nov 15 12:45:20.855057 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1370892-226f-4f85-bac2-f2ad308cbd4f req-ffcd58fa-c16d-480b-bc61-34492f0cb367 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:20.856665 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1370892-226f-4f85-bac2-f2ad308cbd4f req-ffcd58fa-c16d-480b-bc61-34492f0cb367 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 944 time: 0.0605230 Nov 15 12:45:20.926481 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e1370892-226f-4f85-bac2-f2ad308cbd4f req-157fc0d6-5fda-440b-be29-f88ced50093a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0635068 Nov 15 12:45:21.247332 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55082) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:21.409979 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-feb5c1b7-514b-417f-9d53-b1c377a8e427 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.505267 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-feb5c1b7-514b-417f-9d53-b1c377a8e427 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.509467 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-feb5c1b7-514b-417f-9d53-b1c377a8e427 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.551207 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-feb5c1b7-514b-417f-9d53-b1c377a8e427 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=6023ee88c1df4877ad18e49b2f5c6d3c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3024220 Nov 15 12:45:21.552052 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feb5c1b7-514b-417f-9d53-b1c377a8e427 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bea77518-7a10-43c2-b532-aca77aba8da5,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:21.555080 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55090) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:21.604840 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 2074d291-306a-482f-9039-58a67e582e39 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:45:21.622570 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.649003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.726996 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.731062 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=2074d291-306a-482f-9039-58a67e582e39,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:21.731355 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.733273 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/bea77518-7a10-43c2-b532-aca77aba8da5 HTTP/1.1" status: 204 len: 168 time: 0.1768923 Nov 15 12:45:21.745635 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '2074d291-306a-482f-9039-58a67e582e39', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'port_id': '2074d291-306a-482f-9039-58a67e582e39', 'mac_address': 'fa:16:3e:d0:51:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 603, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:45:21.747663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245c0e35-83e8-4dfa-9621-e16e74f83edc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bea77518-7a10-43c2-b532-aca77aba8da5,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:21.809664 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.826628 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2074d291-306a-482f-9039-58a67e582e39 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:45:21.854179 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=2074d291-306a-482f-9039-58a67e582e39,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:21.859249 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:21.921263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:22.092055 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e53d8d-216b-47ba-9517-b21529a4e530 req-c5b2aaa3-987f-4cd4-8553-66e2514acef4 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:22.094571 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-26e53d8d-216b-47ba-9517-b21529a4e530 req-c5b2aaa3-987f-4cd4-8553-66e2514acef4 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0906034 Nov 15 12:45:22.117967 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d234d5-e4a5-4564-9e72-3455895976a4 req-66ee2056-af43-4998-aee6-52000d26bdee tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:22.119720 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-58d234d5-e4a5-4564-9e72-3455895976a4 req-66ee2056-af43-4998-aee6-52000d26bdee tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 945 time: 0.0758619 Nov 15 12:45:22.199063 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-26e53d8d-216b-47ba-9517-b21529a4e530 req-cdbe8ef9-3631-45aa-aedd-6d5a15fda3e3 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0941269 Nov 15 12:45:22.509854 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-58d234d5-e4a5-4564-9e72-3455895976a4 req-d4d5143a-758a-4b87-96f5-2b64fc8616d2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3763475 Nov 15 12:45:23.379070 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529c33dc-2924-4b3a-9b02-0833f4243438 req-3215d877-d5e9-41e7-ac80-8efa65f0140f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:23.381694 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-529c33dc-2924-4b3a-9b02-0833f4243438 req-3215d877-d5e9-41e7-ac80-8efa65f0140f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0681620 Nov 15 12:45:23.456615 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-529c33dc-2924-4b3a-9b02-0833f4243438 req-242e53dc-f3a8-4256-87a2-2a39f52e7b82 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0659876 Nov 15 12:45:23.642233 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d913b6-4d32-458e-b021-3bf81bcbef29 req-63479eac-3727-4ee0-b7cd-fa9aef99ebed tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:23.643789 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-80d913b6-4d32-458e-b021-3bf81bcbef29 req-63479eac-3727-4ee0-b7cd-fa9aef99ebed tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 945 time: 0.0578451 Nov 15 12:45:23.701498 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-80d913b6-4d32-458e-b021-3bf81bcbef29 req-da39f6f0-db54-4430-b94e-9bf81e1bbaa9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512617 Nov 15 12:45:24.592242 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92697cf1-c644-4983-a582-a8cc6173be1d req-bbec19ee-7db9-4224-bc39-bc8955d9a1a3 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:24.594322 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-92697cf1-c644-4983-a582-a8cc6173be1d req-bbec19ee-7db9-4224-bc39-bc8955d9a1a3 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0638406 Nov 15 12:45:24.667177 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-92697cf1-c644-4983-a582-a8cc6173be1d req-ced5bf3d-ef96-433d-bdf6-081b46228844 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0643914 Nov 15 12:45:24.829518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8d3550-3b81-4ec3-bc85-a6cebe9cdbe8 req-99412dc3-dce9-4b3f-97fc-12c633eaee54 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:24.831799 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f8d3550-3b81-4ec3-bc85-a6cebe9cdbe8 req-99412dc3-dce9-4b3f-97fc-12c633eaee54 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 945 time: 0.0601048 Nov 15 12:45:24.897027 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f8d3550-3b81-4ec3-bc85-a6cebe9cdbe8 req-f74de5a8-6530-466f-b2dc-c0593883d5c9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587840 Nov 15 12:45:24.957994 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-39a58356-bacd-4ccd-a5cc-e8bc58dcd690 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:24.959539 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-39a58356-bacd-4ccd-a5cc-e8bc58dcd690 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1137 time: 0.0590706 Nov 15 12:45:25.106095 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-9df7fa5e-6e85-4178-950f-17ea619ba8a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:25.107476 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-9df7fa5e-6e85-4178-950f-17ea619ba8a4 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.1357694 Nov 15 12:45:25.213145 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-59135c4a-fcfa-48e7-a74e-9703439a42b3 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 1000 time: 0.0920017 Nov 15 12:45:25.270377 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-046a1245-23d9-4915-af0c-968bdc14a636 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:25.271886 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-046a1245-23d9-4915-af0c-968bdc14a636 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.0507107 Nov 15 12:45:25.323883 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-e377f425-609d-4c84-81f4-f1b0981afe33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:25.325493 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-e377f425-609d-4c84-81f4-f1b0981afe33 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0456939 Nov 15 12:45:25.333265 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['2074d291-306a-482f-9039-58a67e582e39'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:45:25.467669 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-a34c12b4-9756-4d2d-b2f3-575bef9b805f service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323545 Nov 15 12:45:25.635817 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f92286f3-fa48-4ba9-90c8-6d94ac095045 req-266e66a1-884d-422d-990b-7afa25aabe5c service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1506932 Nov 15 12:45:25.856346 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d311ffc-10d0-4652-ade8-7cdbefe20814 req-efcda220-3dfb-4421-a2e7-af6a31b388f1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:25.869098 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d311ffc-10d0-4652-ade8-7cdbefe20814 req-efcda220-3dfb-4421-a2e7-af6a31b388f1 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.1026151 Nov 15 12:45:25.977980 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d311ffc-10d0-4652-ade8-7cdbefe20814 req-9ceaacb3-c652-4fc5-bb1b-9e54ad5f895d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1078484 Nov 15 12:45:26.097419 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68cf502-2f38-4ebd-8a64-80f6c432b5bf req-a72d362f-d821-4006-8be6-de7e5b3e6964 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:26.103445 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d68cf502-2f38-4ebd-8a64-80f6c432b5bf req-a72d362f-d821-4006-8be6-de7e5b3e6964 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 945 time: 0.0898964 Nov 15 12:45:26.166594 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d68cf502-2f38-4ebd-8a64-80f6c432b5bf req-6542e0ad-4412-4b4b-b180-767d90c70ec0 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608153 Nov 15 12:45:26.866410 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 2074d291-306a-482f-9039-58a67e582e39 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:45:26.922092 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 2074d291-306a-482f-9039-58a67e582e39 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:45:26.926533 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 2074d291-306a-482f-9039-58a67e582e39 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:45:26.926905 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:27.025751 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:27.059606 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2074d291-306a-482f-9039-58a67e582e39'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:45:27.062777 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a782045f-fe15-4cc8-9495-c3d6d41c3a33" -d '{"events": [{"server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "name": "network-vif-plugged", "status": "completed", "tag": "2074d291-306a-482f-9039-58a67e582e39"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:45:27.094290 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=2074d291-306a-482f-9039-58a67e582e39,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:45:27.099419 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:27.150919 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a49b1f-86b0-4d0a-894d-5d9c44b10e06 req-1977f67a-b89d-492a-b44c-ac634fb12bc8 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:27.174477 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-49a49b1f-86b0-4d0a-894d-5d9c44b10e06 req-1977f67a-b89d-492a-b44c-ac634fb12bc8 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.1121998 Nov 15 12:45:27.225816 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:27.252175 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.252513 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.253018 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.253515 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.254170 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.254632 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.255088 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.255479 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.256001 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.256448 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.256946 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.261233 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:27.279046 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-49a49b1f-86b0-4d0a-894d-5d9c44b10e06 req-951b4332-4f37-45ac-a21c-7e8ed17c3206 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1035695 Nov 15 12:45:27.347050 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:45:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58a19f33-4565-4b4f-a707-abecd312a2d3 x-openstack-request-id: req-58a19f33-4565-4b4f-a707-abecd312a2d3 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:45:27.347831 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "name": "network-vif-plugged", "status": "completed", "tag": "2074d291-306a-482f-9039-58a67e582e39", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:45:27.349308 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-58a19f33-4565-4b4f-a707-abecd312a2d3 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:45:27.350190 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2074d291-306a-482f-9039-58a67e582e39', 'code': 200} Nov 15 12:45:27.433783 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e14aeb-b341-4721-9304-a24b9eb303d6 req-d754711b-4c50-4158-a1ce-9248b05ac6a5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:27.435445 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-17e14aeb-b341-4721-9304-a24b9eb303d6 req-d754711b-4c50-4158-a1ce-9248b05ac6a5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0873523 Nov 15 12:45:27.503603 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-17e14aeb-b341-4721-9304-a24b9eb303d6 req-ea2d226b-216a-4651-9ec9-090ed7c804d1 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0539169 Nov 15 12:45:27.665434 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ef54fe-5641-4a55-bf5d-7d7683ac87db req-576dd2a5-fe7e-4597-880f-7a6864dd940c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:27.667918 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e8ef54fe-5641-4a55-bf5d-7d7683ac87db req-576dd2a5-fe7e-4597-880f-7a6864dd940c service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1099 time: 0.0764472 Nov 15 12:45:27.746862 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e8ef54fe-5641-4a55-bf5d-7d7683ac87db req-57a87e7a-d227-4a03-9846-af0f01756d66 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606749 Nov 15 12:45:28.409721 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15136b1f-ccf2-401b-916d-368d6d3ebea7 req-e6f5e25e-8a1b-4fae-8038-5b83ffc42f2a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:28.411297 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-15136b1f-ccf2-401b-916d-368d6d3ebea7 req-e6f5e25e-8a1b-4fae-8038-5b83ffc42f2a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0580151 Nov 15 12:45:28.492864 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-15136b1f-ccf2-401b-916d-368d6d3ebea7 req-0c7bb6b8-a039-465c-a8c8-6d0bb0b1f5af tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0746672 Nov 15 12:45:28.680448 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542d57c3-f0db-4259-b307-0a6cf33ee027 req-b6505545-e18b-42d9-be23-7c16fac676d2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:28.683156 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-542d57c3-f0db-4259-b307-0a6cf33ee027 req-b6505545-e18b-42d9-be23-7c16fac676d2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0751228 Nov 15 12:45:28.771268 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-542d57c3-f0db-4259-b307-0a6cf33ee027 req-94c2dd72-0d60-4b7a-bc69-fc422f88b63e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0765879 Nov 15 12:45:29.637917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7494468-9ed1-4317-9534-4102565f0e6e req-255e860b-53fd-4d01-b45c-1eb619c04519 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:29.639270 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d7494468-9ed1-4317-9534-4102565f0e6e req-255e860b-53fd-4d01-b45c-1eb619c04519 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0669050 Nov 15 12:45:29.736698 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d7494468-9ed1-4317-9534-4102565f0e6e req-12efe851-5af3-4296-9d66-fd2167407e32 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0869303 Nov 15 12:45:29.945416 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aca8fa3-38ed-4ec0-acef-c389516b99d8 req-f059cb36-5ecb-4c82-9d09-1dec2d848355 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:29.948021 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5aca8fa3-38ed-4ec0-acef-c389516b99d8 req-f059cb36-5ecb-4c82-9d09-1dec2d848355 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0666916 Nov 15 12:45:30.033278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5aca8fa3-38ed-4ec0-acef-c389516b99d8 req-6f9d983a-7ea4-4f99-a634-92f9b042b349 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0743704 Nov 15 12:45:30.200384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2d7074-b27f-434e-aff0-cba94d0dd650 req-92273c90-b856-4316-bdb4-9ef6c2edfbb7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:30.206783 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df2d7074-b27f-434e-aff0-cba94d0dd650 req-92273c90-b856-4316-bdb4-9ef6c2edfbb7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0686448 Nov 15 12:45:30.221187 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55268) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:30.226504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'floatingip': {'port_id': '2074d291-306a-482f-9039-58a67e582e39'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:45:30.311900 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:30.889272 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:30.905483 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:30.994713 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09d25f9-04f0-4521-be3a-61147fbc92e1 req-8cc1dbde-5701-4dbf-81c7-4e2db4c19ff2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:30.997406 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a09d25f9-04f0-4521-be3a-61147fbc92e1 req-8cc1dbde-5701-4dbf-81c7-4e2db4c19ff2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.1554682 Nov 15 12:45:31.054809 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Floating IP c75d5182-3626-4f21-b9ea-02821bffadd1 associated. External IP: 172.27.0.80, port: 2074d291-306a-482f-9039-58a67e582e39. Nov 15 12:45:31.403626 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a09d25f9-04f0-4521-be3a-61147fbc92e1 req-149de5cc-22c2-49a2-851e-8f3f3ae9d4be tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3999617 Nov 15 12:45:31.557119 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:45:31.666821 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:45:31.672587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:31.678232 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:45:31.689818 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:31.690456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:45:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:31.700286 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-cd58eedc-acea-446c-a273-23f013d97404 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "PUT /v2.0/floatingips/c75d5182-3626-4f21-b9ea-02821bffadd1 HTTP/1.1" status: 200 len: 991 time: 1.4776404 Nov 15 12:45:31.700735 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'tag': '2074d291-306a-482f-9039-58a67e582e39'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:45:31.703060 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1154bcc2-0f39-43a3-abb6-83ecacb930a4" -d '{"events": [{"name": "network-changed", "server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "tag": "2074d291-306a-482f-9039-58a67e582e39"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:45:31.801695 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:31.806598 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:45:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8416d103-43c7-4a48-93c4-78ed5f71c58c x-openstack-request-id: req-8416d103-43c7-4a48-93c4-78ed5f71c58c {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:45:31.806890 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "tag": "2074d291-306a-482f-9039-58a67e582e39", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:45:31.807141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-8416d103-43c7-4a48-93c4-78ed5f71c58c {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:45:31.807544 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'tag': '2074d291-306a-482f-9039-58a67e582e39', 'status': 'completed', 'code': 200} Nov 15 12:45:32.032002 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c75d5182-3626-4f21-b9ea-02821bffadd1', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.80', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': '2074d291-306a-482f-9039-58a67e582e39', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 548, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:d0:51:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:45:10Z', 'updated_at': '2021-11-15T12:45:30Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:32.062731 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:45:32.071242 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:45:32.071846 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:45:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:32.179040 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:45:32.402177 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c75d5182-3626-4f21-b9ea-02821bffadd1', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.80', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': '2074d291-306a-482f-9039-58a67e582e39', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 548, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:d0:51:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:45:10Z', 'updated_at': '2021-11-15T12:45:30Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:32.432871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19162747-e54d-41a4-9eae-5fdbc23ad33b None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'c75d5182-3626-4f21-b9ea-02821bffadd1', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.80', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': '2074d291-306a-482f-9039-58a67e582e39', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 548, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:d0:51:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:45:10Z', 'updated_at': '2021-11-15T12:45:30Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:45:32.527086 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbef95f9-a240-400c-8c59-f39d697aa05d req-f7e15e7a-83e3-4781-aefc-0700a42f6c2d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:32.528631 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fbef95f9-a240-400c-8c59-f39d697aa05d req-f7e15e7a-83e3-4781-aefc-0700a42f6c2d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0510852 Nov 15 12:45:32.595522 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fbef95f9-a240-400c-8c59-f39d697aa05d req-e61c783d-0ab2-4f7b-8863-2ecc5934bc1a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0600467 Nov 15 12:45:32.646164 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27f92b91-e3c2-4b1b-adad-92c66fbf749e None None] New status for floating IP c75d5182-3626-4f21-b9ea-02821bffadd1: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:45:33.335693 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e798ba72-590d-4945-9108-d8c3da35b8c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:33.725296 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4185fe51-eafd-4c40-9c9a-bd6904868aca req-bf4ca6c2-4dcb-449a-9703-655104c0e11e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:33.726833 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4185fe51-eafd-4c40-9c9a-bd6904868aca req-bf4ca6c2-4dcb-449a-9703-655104c0e11e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0620103 Nov 15 12:45:33.794178 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4185fe51-eafd-4c40-9c9a-bd6904868aca req-fee23b40-58b9-49c1-a2b6-3f8acc6d97c5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0606525 Nov 15 12:45:33.918685 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-d9ea994d-04db-4385-9c6c-031639715356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:33.921371 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-d9ea994d-04db-4385-9c6c-031639715356 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1099 time: 0.0669470 Nov 15 12:45:34.044475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-a441c656-db7e-477c-a6f5-8f44bdcfe468 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:34.045985 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-a441c656-db7e-477c-a6f5-8f44bdcfe468 service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1096087 Nov 15 12:45:34.127292 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-287d29ca-565d-4549-8c73-615e6aad8c0f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 1001 time: 0.0670459 Nov 15 12:45:34.188719 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-a6f6462a-27ab-4789-bd2f-04a15ff57f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:34.190962 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-a6f6462a-27ab-4789-bd2f-04a15ff57f20 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0561521 Nov 15 12:45:34.246526 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-4dda66be-3206-49d9-af8b-5d59cf937e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:34.248325 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-4dda66be-3206-49d9-af8b-5d59cf937e67 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0464075 Nov 15 12:45:34.357491 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-4e191000-e280-4377-93cc-79521c1026b5 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1001213 Nov 15 12:45:34.489248 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1154bcc2-0f39-43a3-abb6-83ecacb930a4 req-9bf202e8-ea98-41af-8912-cab75a8efe39 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1214774 Nov 15 12:45:34.966988 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbb6d87-15d2-4202-8837-b319c4f27ed6 req-df7da7ff-876a-4feb-8c1c-35b08b9ceecb tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:34.973397 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1bbb6d87-15d2-4202-8837-b319c4f27ed6 req-df7da7ff-876a-4feb-8c1c-35b08b9ceecb tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0916927 Nov 15 12:45:35.057150 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1bbb6d87-15d2-4202-8837-b319c4f27ed6 req-a4fff553-f541-4570-bb45-f3d8b0b5a183 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0752492 Nov 15 12:45:35.774478 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9f38cf08-c7de-40c8-b152-af9eee732723 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:36.249297 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-365669bc-f114-47dd-b326-45bbeef2bcbb req-ea277e16-66b7-437e-ad9a-efb417f8c789 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:36.253558 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-365669bc-f114-47dd-b326-45bbeef2bcbb req-ea277e16-66b7-437e-ad9a-efb417f8c789 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0747323 Nov 15 12:45:36.316898 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-365669bc-f114-47dd-b326-45bbeef2bcbb req-7ae8e1eb-5d7b-48a5-9af1-a882e3f27df5 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0588017 Nov 15 12:45:36.861483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.344661 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55386) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:37.480043 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a31d2628-295d-4e88-a8a4-86586a03ec9a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.502527 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0708a24a-f95c-4e32-b1d4-2aec0974d497 req-ccbecd6d-ad09-410a-a728-40aec1517dec tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:37.504103 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0708a24a-f95c-4e32-b1d4-2aec0974d497 req-ccbecd6d-ad09-410a-a728-40aec1517dec tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0909035 Nov 15 12:45:37.600882 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0708a24a-f95c-4e32-b1d4-2aec0974d497 req-2a564ca9-b925-43a3-a1b4-de742c536a2d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0905848 Nov 15 12:45:37.637970 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a31d2628-295d-4e88-a8a4-86586a03ec9a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.642799 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a31d2628-295d-4e88-a8a4-86586a03ec9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.688215 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a31d2628-295d-4e88-a8a4-86586a03ec9a admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=4febeeff033b436ba3c9efc2a801d37e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3419878 Nov 15 12:45:37.689240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31d2628-295d-4e88-a8a4-86586a03ec9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0dc1408-11be-4a2d-a006-3791dfb07771,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:37.690959 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55394) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:37.752360 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.784916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.846184 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.848931 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:37.850128 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/d0dc1408-11be-4a2d-a006-3791dfb07771 HTTP/1.1" status: 204 len: 168 time: 0.1581180 Nov 15 12:45:37.859382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af505a1-f0a5-40a8-9677-3fc31b5c59cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0dc1408-11be-4a2d-a006-3791dfb07771,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:38.334124 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:38.756320 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4065423d-1297-461c-8ee9-6fb9eff7f639 req-6f658024-eb10-49f1-ba23-d3e82105f88f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:38.757911 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4065423d-1297-461c-8ee9-6fb9eff7f639 req-6f658024-eb10-49f1-ba23-d3e82105f88f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0697327 Nov 15 12:45:38.837807 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4065423d-1297-461c-8ee9-6fb9eff7f639 req-ff5a7442-720b-408e-987c-352e94fc6a9b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0704801 Nov 15 12:45:39.136675 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:39.961493 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9dba0e2-0eaf-49be-a79a-ae95130db877 req-2c4122ea-d69c-4654-8e06-99b9fe748c0a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:39.963496 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a9dba0e2-0eaf-49be-a79a-ae95130db877 req-2c4122ea-d69c-4654-8e06-99b9fe748c0a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0523243 Nov 15 12:45:40.035019 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a9dba0e2-0eaf-49be-a79a-ae95130db877 req-ab61b202-fe65-47b1-8300-61ea389b84d0 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0655513 Nov 15 12:45:41.167428 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fea82a4d-1fdc-4ed8-b305-e0f6566c2090 req-281edde9-465c-4681-9d5d-584e276fff38 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:41.168993 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fea82a4d-1fdc-4ed8-b305-e0f6566c2090 req-281edde9-465c-4681-9d5d-584e276fff38 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0569117 Nov 15 12:45:41.248740 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fea82a4d-1fdc-4ed8-b305-e0f6566c2090 req-0a056fe1-34a7-4d6c-9a3c-1795ed2b0464 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0719008 Nov 15 12:45:42.381398 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff54ee41-5bee-454d-94cd-629d7060def6 req-5f54ec2d-dac1-4e5d-9444-6af0aa8f959b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:42.382947 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ff54ee41-5bee-454d-94cd-629d7060def6 req-5f54ec2d-dac1-4e5d-9444-6af0aa8f959b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0565786 Nov 15 12:45:42.448843 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ff54ee41-5bee-454d-94cd-629d7060def6 req-8a6cedf6-36c0-4204-8ae6-e6808b36df71 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0592978 Nov 15 12:45:43.383883 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-cd8fc06d-92a9-4dd4-9ee5-b78511a8e21d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:43.385365 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-cd8fc06d-92a9-4dd4-9ee5-b78511a8e21d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1137 time: 0.0465510 Nov 15 12:45:43.504634 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-a5be595b-1f25-4af4-867d-e539c4c99c53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:43.506118 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-a5be595b-1f25-4af4-867d-e539c4c99c53 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.0977268 Nov 15 12:45:43.589636 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e839be8-8935-4ed4-a31d-9ef9dee362bd req-37eed8ba-cd06-42e2-9453-cde0d1debcfc tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:43.591181 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5e839be8-8935-4ed4-a31d-9ef9dee362bd req-37eed8ba-cd06-42e2-9453-cde0d1debcfc tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0618231 Nov 15 12:45:43.606757 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-a87aa9ce-e0a9-4427-aea7-784054f0d0db service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 1000 time: 0.0867772 Nov 15 12:45:43.669751 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5e839be8-8935-4ed4-a31d-9ef9dee362bd req-c0863833-54ad-4620-9075-991fb826cbfc tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0712872 Nov 15 12:45:43.677916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-cb6c57e6-c0f8-48ee-8c92-97c924806f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:43.680348 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-cb6c57e6-c0f8-48ee-8c92-97c924806f7f service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.0569813 Nov 15 12:45:43.741041 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-2db0047d-6afe-47ea-8892-f14f90e20411 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:43.742554 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-2db0047d-6afe-47ea-8892-f14f90e20411 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0535777 Nov 15 12:45:43.845981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-1960c415-8971-4024-a3c3-36337e4fae11 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923955 Nov 15 12:45:43.964511 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ff0b0b00-130b-47de-a26c-c20c5bffb7a2 req-c33d78e6-87f5-4019-a716-61b647b4aaca service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1105721 Nov 15 12:45:44.080229 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:44.827327 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea9c3bc-4b31-4d6e-b6e4-214a540c919c req-3966e496-054e-4473-97d8-968bcf87fd28 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:44.829293 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9ea9c3bc-4b31-4d6e-b6e4-214a540c919c req-3966e496-054e-4473-97d8-968bcf87fd28 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0691717 Nov 15 12:45:44.914593 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9ea9c3bc-4b31-4d6e-b6e4-214a540c919c req-956b4883-c66d-4a00-a3dd-93c9c3c01fad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0774512 Nov 15 12:45:45.088283 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55508) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:45.142870 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Deleting subnet 3f98b94d-b67f-41a2-843a-6c7c0c51fb68 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:45:45.147552 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.203089 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.246676 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.310699 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.345355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3f98b94d-b67f-41a2-843a-6c7c0c51fb68,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:45.347948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.351369 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] 10.222.0.44 "DELETE /v2.0/subnets/3f98b94d-b67f-41a2-843a-6c7c0c51fb68 HTTP/1.1" status: 204 len: 168 time: 0.2589338 Nov 15 12:45:45.355558 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55512) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:45.358139 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.359027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.359510 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.360015 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.360641 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.361220 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.361807 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.362384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.362924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.363473 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.363947 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.364344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba466d9-c8e0-418b-b905-1e98b4ad981d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:45.433914 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.520074 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.542260 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b7abe99c-ff8e-4248-acb4-9c230b0d78fd']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:45.554222 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eec395e4-864f-4540-8982-74f84a015989') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:45.554585 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eec395e4-864f-4540-8982-74f84a015989') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:45:45.568006 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.583715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.591807 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Releasing vlan 625 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:45:45.592317 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:45:45.594731 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:45:45.678778 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.684733 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:45.688298 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] 10.222.0.44 "DELETE /v2.0/networks/b7abe99c-ff8e-4248-acb4-9c230b0d78fd HTTP/1.1" status: 204 len: 168 time: 0.3306911 Nov 15 12:45:45.706154 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3701779b-2b81-48d8-9eab-d7923570e5ee admin admin] Pushing event deleted for resources: {'Network': ['ID=b7abe99c-ff8e-4248-acb4-9c230b0d78fd,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:45.916908 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55516) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:45.958118 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bda8a80f-5130-4db2-8e7b-4f1aadf29c33 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=171ad5c938bc4bcebdf3addd4a1692dc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400538 Nov 15 12:45:45.960635 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55520) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:46.050104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:46.080148 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:46.101587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1a7f25-2d42-43bd-9653-7768cd636979 req-a6595012-5630-4a72-838c-64d1a6319815 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:46.103099 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7b1a7f25-2d42-43bd-9653-7768cd636979 req-a6595012-5630-4a72-838c-64d1a6319815 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0872598 Nov 15 12:45:46.194784 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:46.197865 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:46.200541 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e0b880aa-7531-4afc-b2bc-0811ae872683 HTTP/1.1" status: 204 len: 168 time: 0.2375278 Nov 15 12:45:46.212839 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7b1a7f25-2d42-43bd-9653-7768cd636979 req-c1afde56-7042-421c-8f16-626f0afa812d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1018953 Nov 15 12:45:46.218629 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0b880aa-7531-4afc-b2bc-0811ae872683,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:46.227703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.227703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.227703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.228319 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.228521 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.228917 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.229315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.229712 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.230142 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.230549 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.231096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:46.231444 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d9fd847-f173-4f4d-86ba-6a88bd5cf4c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:45:47.345947 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c11840a-3f97-4ff6-8d8b-f89722b4bd24 req-9a5ebb7c-518c-4141-9176-5f42ffe17ad9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:47.347424 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c11840a-3f97-4ff6-8d8b-f89722b4bd24 req-9a5ebb7c-518c-4141-9176-5f42ffe17ad9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0500486 Nov 15 12:45:47.421468 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4c11840a-3f97-4ff6-8d8b-f89722b4bd24 req-4fbe6a14-647e-400e-b226-c279a468ad69 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0666976 Nov 15 12:45:48.539357 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b77226-2354-4097-94f1-3f8f14eb5103 req-0eba505f-a78d-4d00-a81d-62fc3e6582a7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:48.541023 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-15b77226-2354-4097-94f1-3f8f14eb5103 req-0eba505f-a78d-4d00-a81d-62fc3e6582a7 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0533178 Nov 15 12:45:48.605159 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-15b77226-2354-4097-94f1-3f8f14eb5103 req-e619c659-6a4b-4f4a-b17b-8651a393213b tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0561619 Nov 15 12:45:49.745879 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5b908d-0122-4cf2-b13e-0522a1aabb39 req-bff3087e-1461-464c-a723-7678eabc309d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:49.747439 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2c5b908d-0122-4cf2-b13e-0522a1aabb39 req-bff3087e-1461-464c-a723-7678eabc309d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0713742 Nov 15 12:45:49.760207 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:45:49.815994 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2c5b908d-0122-4cf2-b13e-0522a1aabb39 req-8f79cfc9-1eb5-4c27-b511-5bf2fd1043d9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0614858 Nov 15 12:45:50.942663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f869db86-e5fe-4225-bd4e-42bbe5d7fa98 req-5a94c2b7-a12c-41b5-b560-371a7ecad884 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:50.944138 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f869db86-e5fe-4225-bd4e-42bbe5d7fa98 req-5a94c2b7-a12c-41b5-b560-371a7ecad884 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0504925 Nov 15 12:45:51.006023 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f869db86-e5fe-4225-bd4e-42bbe5d7fa98 req-9ea79620-893e-4c24-a6c6-f053ad25311a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0558047 Nov 15 12:45:52.129000 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e2a621-f6eb-4671-b18b-3af7b9c030cb req-0d5fe1ce-e917-4dff-8630-e69069a85ad0 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:52.130559 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-27e2a621-f6eb-4671-b18b-3af7b9c030cb req-0d5fe1ce-e917-4dff-8630-e69069a85ad0 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0548859 Nov 15 12:45:52.209654 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-27e2a621-f6eb-4671-b18b-3af7b9c030cb req-a77a79f1-175e-4539-8780-860e532db17e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0722737 Nov 15 12:45:53.350724 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67fb4493-96ef-42bf-9f8b-0329d2fc5edd req-d2c15bb8-2d92-4726-8c5e-daa38f3d9140 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:45:53.352338 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-67fb4493-96ef-42bf-9f8b-0329d2fc5edd req-d2c15bb8-2d92-4726-8c5e-daa38f3d9140 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0614483 Nov 15 12:45:53.443686 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-67fb4493-96ef-42bf-9f8b-0329d2fc5edd req-3e8d672f-738d-4d7e-a827-f279640d3fc8 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&id=c1bab170-a392-46e1-87bf-5ff04474b15e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0853863 Nov 15 12:45:58.265237 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55640) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:58.409245 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e64dc7b5-f975-4b5f-8708-37c0dece969d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.495129 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e64dc7b5-f975-4b5f-8708-37c0dece969d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.499917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e64dc7b5-f975-4b5f-8708-37c0dece969d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.536798 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e64dc7b5-f975-4b5f-8708-37c0dece969d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a2027bf-c041-4b3a-bf0d-3b540b316a42,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:45:58.541205 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e64dc7b5-f975-4b5f-8708-37c0dece969d admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=66935ff14e234cd08f296468a6485d5e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2748058 Nov 15 12:45:58.543957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55644) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:45:58.600319 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.622908 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.678860 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.681432 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:45:58.682595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/1a2027bf-c041-4b3a-bf0d-3b540b316a42 HTTP/1.1" status: 204 len: 168 time: 0.1376235 Nov 15 12:45:58.691589 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5104c1ee-71c6-4c9c-84c7-f00ee5e48fc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a2027bf-c041-4b3a-bf0d-3b540b316a42,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:03.338536 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-04985982-39be-4947-b2ff-c3feb5f1fc4b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:05.776411 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-548214af-10fa-4239-b385-6551f78eec95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:06.861309 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:08.340409 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:09.120811 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:12.208599 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffcdf5a-10c5-4a32-950e-a21066dabc7a req-c2ed7cb3-e4eb-4d59-80fb-da5abb540471 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:12.210262 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7ffcdf5a-10c5-4a32-950e-a21066dabc7a req-c2ed7cb3-e4eb-4d59-80fb-da5abb540471 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0590954 Nov 15 12:46:12.266756 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7ffcdf5a-10c5-4a32-950e-a21066dabc7a req-e1c07e34-7872-4fd5-9ce9-15a2d9fc208a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503092 Nov 15 12:46:13.397506 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226fc307-40f5-4f86-ac7d-9cb5eed749b1 req-b1c7d979-a820-42a9-a002-08261eba466f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:13.399040 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-226fc307-40f5-4f86-ac7d-9cb5eed749b1 req-b1c7d979-a820-42a9-a002-08261eba466f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0550454 Nov 15 12:46:13.448819 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-226fc307-40f5-4f86-ac7d-9cb5eed749b1 req-8325e034-ea69-4402-8b37-7e043ce213cf tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437860 Nov 15 12:46:14.087138 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.146990 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-fed58146-7de6-4374-ae68-192ca895fd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:14.148616 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-fed58146-7de6-4374-ae68-192ca895fd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0518105 Nov 15 12:46:14.372191 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Deleting port 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:14.372448 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.466279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] For port 36928b8a-e800-43e0-9edd-e13ae44ee93e, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=36928b8a-e800-43e0-9edd-e13ae44ee93e,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:14.466637 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.579277 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7bd5225-4572-4392-94a9-d6c2a5d7620b req-6b8ddec0-eb91-43b1-9d79-6fbe1c26c998 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:14.580863 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e7bd5225-4572-4392-94a9-d6c2a5d7620b req-6b8ddec0-eb91-43b1-9d79-6fbe1c26c998 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 946 time: 0.0553505 Nov 15 12:46:14.636796 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-e7bd5225-4572-4392-94a9-d6c2a5d7620b req-8988bb1c-3cf2-4d3e-9f42-8e871e444d4b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=da4a15c8-b16c-4a62-801f-33492179f865&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495520 Nov 15 12:46:14.720974 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.721401 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.721675 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Floating IP c863ddfc-191f-4bbe-968a-f38732b415b3 disassociated. External IP: 172.27.0.101, port: 36928b8a-e800-43e0-9edd-e13ae44ee93e. Nov 15 12:46:14.722020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Calling delete_port for 36928b8a-e800-43e0-9edd-e13ae44ee93e owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:14.864456 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:14.894944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'Port': ['ID=36928b8a-e800-43e0-9edd-e13ae44ee93e,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:15.024733 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:46:15.132546 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:46:15.143725 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:46:15.154191 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:15.154723 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:15.172194 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] No DVR routers for this DVR port 36928b8a-e800-43e0-9edd-e13ae44ee93e on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:15.175296 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:15.179095 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ee5b5a50-5cbc-4e5f-8fc9-f61de4bc8582 req-9d580a22-da5b-425b-863a-56413b976140 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "DELETE /v2.0/ports/36928b8a-e800-43e0-9edd-e13ae44ee93e HTTP/1.1" status: 204 len: 173 time: 0.8969486 Nov 15 12:46:15.179642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-deleted', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:15.182247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f04f747-72c9-442f-849b-a4ea514e6685" -d '{"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-deleted", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:15.220040 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-155be85b-55d4-4d9a-8403-481169bef096 x-openstack-request-id: req-155be85b-55d4-4d9a-8403-481169bef096 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:15.220440 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b134ea05-c646-4f06-89f0-5e414ec110fe", "name": "network-vif-deleted", "tag": "36928b8a-e800-43e0-9edd-e13ae44ee93e", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:15.220746 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-155be85b-55d4-4d9a-8403-481169bef096 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:15.221213 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b134ea05-c646-4f06-89f0-5e414ec110fe', 'name': 'network-vif-deleted', 'tag': '36928b8a-e800-43e0-9edd-e13ae44ee93e', 'status': 'completed', 'code': 200} Nov 15 12:46:15.392076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:15.611066 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:15.638059 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:46:15.647122 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:15.647735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:15.777264 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:15.784794 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1753ad29-cd1b-4866-9fe2-199543b55b63 req-12ee5fb7-73df-41a3-a2e7-f940cecdafa1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=b134ea05-c646-4f06-89f0-5e414ec110fe HTTP/1.1" status: 200 len: 210 time: 0.0402210 Nov 15 12:46:16.009987 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:16.039014 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb97ea4-2cfa-44d7-ba94-8a6ea0b675d6 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:46:16.261433 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8beee6a6-a896-44ca-9cb4-dce9a1b1bce1 None None] New status for floating IP c863ddfc-191f-4bbe-968a-f38732b415b3: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:46:16.888765 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55730) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:16.959558 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:16.988314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.052777 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.055628 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.057159 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "DELETE /v2.0/security-groups/da4a15c8-b16c-4a62-801f-33492179f865 HTTP/1.1" status: 204 len: 168 time: 0.1669276 Nov 15 12:46:17.059826 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55734) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:17.075136 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.api.v2.resource [None req-2343ebdf-5095-4103-a876-36469c1657a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] show failed (client error): The resource could not be found. Nov 15 12:46:17.075353 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4e4474-c444-4a34-8b1e-86820400c9c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=da4a15c8-b16c-4a62-801f-33492179f865,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:17.077042 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-2343ebdf-5095-4103-a876-36469c1657a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups/da4a15c8-b16c-4a62-801f-33492179f865 HTTP/1.1" status: 404 len: 347 time: 0.0160086 Nov 15 12:46:17.079096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55736) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:17.217215 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Deleting port ecf51f4c-5ca7-49e7-96f3-5839637ce8f8 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:17.218363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.295440 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.296372 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.308011 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Calling delete_port for ecf51f4c-5ca7-49e7-96f3-5839637ce8f8 owned by network:floatingip {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:17.448043 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.474117 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'Port': ['ID=ecf51f4c-5ca7-49e7-96f3-5839637ce8f8,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:17.539347 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.542156 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:17.543349 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-3d561365-8382-4fc3-b063-bdba977be9f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "DELETE /v2.0/floatingips/c863ddfc-191f-4bbe-968a-f38732b415b3 HTTP/1.1" status: 204 len: 168 time: 0.4633253 Nov 15 12:46:19.027468 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55754) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:19.032786 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1706831771', 'description': 'tempest-description--1374850249'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:19.054834 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.121143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.124853 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.150355 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:19.157143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.158391 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1298518 Nov 15 12:46:19.160623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a952101-5b27-4e15-a6ec-b4e384838954 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8410d98a-ade6-47fe-97c8-fca1a0ef24ea,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:19.161526 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55756) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:19.166443 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group_rule': {'security_group_id': '8410d98a-ade6-47fe-97c8-fca1a0ef24ea', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:19.183898 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 36928b8a-e800-43e0-9edd-e13ae44ee93e {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:19.184275 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 36928b8a-e800-43e0-9edd-e13ae44ee93e not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:19.199139 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.250913 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.254764 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.275263 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32ad46f6-3a3b-430e-923a-c56ba69dea89,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:19.286860 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.289097 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-01cbd3a5-f65c-4df0-be84-1025929559ae tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1256287 Nov 15 12:46:19.291204 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55762) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:19.297411 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'security_group_rule': {'security_group_id': '8410d98a-ade6-47fe-97c8-fca1a0ef24ea', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:19.329908 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.397235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.401649 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.423989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=87733278-5558-4209-abe2-1f75b5ac9020,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:19.432659 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.437677 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3824b503-7529-4d6f-9198-8edfa7f3cd2d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1414168 Nov 15 12:46:19.437933 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55766) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:19.442852 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:19.468017 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.587399 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.706290 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Allocated IP 172.27.0.39 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/f60311e0-f678-4ee3-8bab-e7a9af94b729) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:46:19.816489 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.861895 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:19.901737 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:46:19.904602 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:46:19.908846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:46:19.914657 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=f60311e0-f678-4ee3-8bab-e7a9af94b729,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:20.005356 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.048241 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.215864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.221813 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.286877 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=f60311e0-f678-4ee3-8bab-e7a9af94b729,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:20.304210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.321832 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:20.323183 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-285d71e5-d110-407f-b8d0-6e457a789acd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8841851 Nov 15 12:46:20.525657 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-c3d92099-77da-4266-821a-cf63b3c7c630 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-securitygroup--1706831771&fields=id&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 267 time: 0.0502861 Nov 15 12:46:20.874667 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-6b0dd4f2-7e1f-45fa-ad56-ffaaec04271f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:20.876151 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-6b0dd4f2-7e1f-45fa-ad56-ffaaec04271f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 817 time: 0.3431485 Nov 15 12:46:20.891445 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-078040f0-3e74-47e8-b159-1c5cee859854 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/quotas/5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 375 time: 0.0095088 Nov 15 12:46:20.943367 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-6ea6dd06-c1fc-4c7f-9be6-f75c0258dd7e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0464692 Nov 15 12:46:21.150480 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-c5a8ad06-fa01-4ae0-a81a-0b842171b6b9 service neutron] 10.222.0.44 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1936922 Nov 15 12:46:21.244296 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-a7b2185f-78e7-4060-b4f0-dd70e7e2c928 service neutron] 10.222.0.44 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877388 Nov 15 12:46:21.399835 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7be4783b-74ff-4d3c-8fc9-fbdf01281647 req-ff08dc84-40b0-4a8e-9512-c332085f1935 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 210 time: 0.0261176 Nov 15 12:46:22.460956 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-ae610344-45aa-46a0-a073-b85579b23232 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:22.460956 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-ae610344-45aa-46a0-a073-b85579b23232 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 817 time: 0.1140866 Nov 15 12:46:22.527226 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e6dd60b4-fd74-4f2b-8e43-a6729d8b4f86 req-f2ba2758-4064-436a-ae98-6b29c7c27f74 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 210 time: 0.0440016 Nov 15 12:46:22.569933 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-74a0089b-3270-4b67-a022-a8ad66cb8283 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 380 time: 0.0879354 Nov 15 12:46:22.581099 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'port': {'device_id': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'admin_state_up': True, 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'security_groups': ['8410d98a-ade6-47fe-97c8-fca1a0ef24ea']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:22.690286 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Made reservation on behalf of 5e23e880e5674cdb85e83c616f14f549 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:46:22.694050 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:22.831670 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Allocated IP 172.20.0.3 (7e6e34e4-b05e-4c98-9266-31ca11e16a97/45ee91be-922e-4559-8cc0-d7bba19c0c19/f03748f1-6421-4492-82d3-c659e117188c) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:46:22.968887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.003107 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.047941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:46:23.050920 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:46:23.054749 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:46:23.061172 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:23.109583 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:23.110234 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.129296 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-e4a471ce-8476-41ec-9c15-c1529ae3c9a8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5518506 Nov 15 12:46:23.150385 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Request body: {'port': {'device_id': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:23.213014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.347250 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4b2ccc85-b86c-40d3-bc38-662d83d682f4 None None] Provisioning complete for port f03748f1-6421-4492-82d3-c659e117188c triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:46:23.347826 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4b2ccc85-b86c-40d3-bc38-662d83d682f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.385375 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4b2ccc85-b86c-40d3-bc38-662d83d682f4 None None] Port f03748f1-6421-4492-82d3-c659e117188c cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:46:23.476682 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f03748f1-6421-4492-82d3-c659e117188c {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:46:23.484675 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.496891 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Transition to ACTIVE for port object f03748f1-6421-4492-82d3-c659e117188c will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:46:23.500592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.572857 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:23.631207 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Attempting to bind port f03748f1-6421-4492-82d3-c659e117188c on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:46:23.631547 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Attempting to bind port f03748f1-6421-4492-82d3-c659e117188c by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:46:23.631872 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Attempting to bind port f03748f1-6421-4492-82d3-c659e117188c on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:46:23.636701 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Port f03748f1-6421-4492-82d3-c659e117188c on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:46:23.637014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Attempting to bind port f03748f1-6421-4492-82d3-c659e117188c on network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:46:23.643699 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 46, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:46:23.645576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Checking segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:46:23.645576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Bound using segment: {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:46:23.645576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Bound port: f03748f1-6421-4492-82d3-c659e117188c, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:46:23.645576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.664050 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863717c7-c19e-4047-a465-b1541bec01c4 req-5e691671-b28b-4f8c-b247-b29540d0dc74 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:23.665589 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-863717c7-c19e-4047-a465-b1541bec01c4 req-5e691671-b28b-4f8c-b247-b29540d0dc74 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0611339 Nov 15 12:46:23.714465 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:46:23.718709 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:46:23.720731 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-863717c7-c19e-4047-a465-b1541bec01c4 req-14c6e255-bc7d-438b-a57c-a6c2e8737078 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484948 Nov 15 12:46:23.723742 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.758986 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:23.759889 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:23.761301 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] 10.222.0.61 "PUT /v2.0/ports/f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 1093 time: 0.6158941 Nov 15 12:46:23.764413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:23.766825 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4" -d '{"events": [{"name": "network-changed", "server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:23.801927 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4c1ad9-4884-4f2e-9505-7a16cd93fd4f service neutron] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:23.815087 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d8600b1-fb93-4faa-9010-07655ad62835 x-openstack-request-id: req-2d8600b1-fb93-4faa-9010-07655ad62835 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:23.815456 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:23.815782 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-2d8600b1-fb93-4faa-9010-07655ad62835 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:23.816285 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'status': 'completed', 'code': 200} Nov 15 12:46:23.886131 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-a391495b-218d-4c0a-b210-404162a33a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:23.887830 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-a391495b-218d-4c0a-b210-404162a33a35 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1096 time: 0.0501645 Nov 15 12:46:23.939432 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-1973b0fb-116d-4099-97b1-861828d52950 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 217 time: 0.0360570 Nov 15 12:46:23.992826 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-8b7e73b5-c693-4bd3-b10d-5098b7b236af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:23.994292 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-8b7e73b5-c693-4bd3-b10d-5098b7b236af service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0449011 Nov 15 12:46:24.052715 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-4cf7bf52-4623-4b3e-b205-e2bb6d924a57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.054266 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-4cf7bf52-4623-4b3e-b205-e2bb6d924a57 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0518837 Nov 15 12:46:24.147578 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-518f0bd4-6ec9-46b9-ba1c-2ded302362ca service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825882 Nov 15 12:46:24.248737 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5e12fb6b-51c6-4b07-9a5d-4bd68071e3af req-3ef74d0d-aabc-4dd9-9ede-2f566925544d service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932343 Nov 15 12:46:24.404538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-6bfb7abc-becd-42ec-b865-46d125d60b6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.407876 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-6bfb7abc-becd-42ec-b865-46d125d60b6c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1096 time: 0.0627441 Nov 15 12:46:24.513065 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-44d62a31-d48b-4fdf-8c23-303d8b261ca3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.514631 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-44d62a31-d48b-4fdf-8c23-303d8b261ca3 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.0996957 Nov 15 12:46:24.557067 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-ca4d06f0-8b76-4307-b426-dfe333c88a57 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 217 time: 0.0342865 Nov 15 12:46:24.606559 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-7cd01afc-4cb1-43cd-b272-4302cf17f9ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.607993 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-7cd01afc-4cb1-43cd-b272-4302cf17f9ab service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0431769 Nov 15 12:46:24.658646 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-507964d0-ccc5-435c-8edf-d59545f5f036 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.660344 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-507964d0-ccc5-435c-8edf-d59545f5f036 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447316 Nov 15 12:46:24.756842 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-0b71ef07-7936-4c41-8aef-674c4eeb69c9 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876176 Nov 15 12:46:24.850983 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afc148a-80f1-4b8c-b8dc-c67ec37a8ffb req-052bb373-6b96-445d-89a3-6f7369726e9e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:24.852728 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1afc148a-80f1-4b8c-b8dc-c67ec37a8ffb req-052bb373-6b96-445d-89a3-6f7369726e9e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0532868 Nov 15 12:46:24.864309 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e80b4e0d-8ffb-43c6-adc9-6a6f190bcba4 req-0f5dd56c-672e-438e-964c-394c0bfbcd40 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945508 Nov 15 12:46:24.912580 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1afc148a-80f1-4b8c-b8dc-c67ec37a8ffb req-30b66ec2-c18c-4f19-a532-326c23a09794 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535679 Nov 15 12:46:26.053118 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c5b1fa-f684-46da-8fa8-4aba308a6d81 req-75e839b9-7948-474f-88ea-5bedfed33a6f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:26.054624 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-01c5b1fa-f684-46da-8fa8-4aba308a6d81 req-75e839b9-7948-474f-88ea-5bedfed33a6f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0590863 Nov 15 12:46:26.103943 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-01c5b1fa-f684-46da-8fa8-4aba308a6d81 req-f80b05fe-5111-4ea2-b3c7-20afca351e95 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426464 Nov 15 12:46:26.759616 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:46:27.210925 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:46:27.264374 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b137604-9b45-42e0-a1d0-87df691d5bec req-19cef258-0197-4e97-924b-7e37fc16be6f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:27.266480 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b137604-9b45-42e0-a1d0-87df691d5bec req-19cef258-0197-4e97-924b-7e37fc16be6f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0825026 Nov 15 12:46:27.326122 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b137604-9b45-42e0-a1d0-87df691d5bec req-8501bb49-aa80-4d95-a3d3-fc8b14a9ec38 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516140 Nov 15 12:46:27.335021 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:27.337533 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be0f0bc-8628-4e5c-a9b4-5a4a65782778 req-466fde9c-f0b3-45ae-8b65-1ed3ca04a8fb tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:27.339100 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5be0f0bc-8628-4e5c-a9b4-5a4a65782778 req-466fde9c-f0b3-45ae-8b65-1ed3ca04a8fb tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0540059 Nov 15 12:46:27.353158 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'f03748f1-6421-4492-82d3-c659e117188c', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:46:27.397828 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:27.398739 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5be0f0bc-8628-4e5c-a9b4-5a4a65782778 req-ba2d6d00-4a8d-4f1d-b960-df385a9a144e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529337 Nov 15 12:46:27.419485 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f03748f1-6421-4492-82d3-c659e117188c {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:46:27.441115 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:27.445597 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:27.507387 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:27.515428 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.515678 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.516017 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.516383 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.516708 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.517030 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.517355 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.517673 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.517993 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.518302 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.518617 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.518929 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:27.836516 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['f03748f1-6421-4492-82d3-c659e117188c'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:46:28.456509 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec85b82-1505-4711-b23c-414ccc7ba6e7 req-a1524cc8-0ace-4469-81ab-37edc1b11c3d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:28.458080 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aec85b82-1505-4711-b23c-414ccc7ba6e7 req-a1524cc8-0ace-4469-81ab-37edc1b11c3d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 944 time: 0.0542448 Nov 15 12:46:28.511494 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aec85b82-1505-4711-b23c-414ccc7ba6e7 req-c8fb7446-8512-4b2d-b25c-00acfff9fd9f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468781 Nov 15 12:46:28.547030 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50abcbb5-f31c-40d6-a1ea-d00f54b475b9 req-15b83d62-6a82-4f31-9884-6fb937e0cce2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:28.548466 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-50abcbb5-f31c-40d6-a1ea-d00f54b475b9 req-15b83d62-6a82-4f31-9884-6fb937e0cce2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0663760 Nov 15 12:46:28.599587 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-50abcbb5-f31c-40d6-a1ea-d00f54b475b9 req-1485930c-9c76-4abe-838f-ee5ebad56fd9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450656 Nov 15 12:46:29.211514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:46:29.260138 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port f03748f1-6421-4492-82d3-c659e117188c completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:46:29.264301 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port f03748f1-6421-4492-82d3-c659e117188c triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:46:29.265174 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:29.340601 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:29.368633 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:29.374112 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7b2c7fb-eaf0-4540-adb5-609d0025a72d" -d '{"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:29.387871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:29.395771 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:29.424433 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c75e574b-a490-4261-9569-e028dea8e7a2 x-openstack-request-id: req-c75e574b-a490-4261-9569-e028dea8e7a2 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:29.424433 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:29.424433 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-c75e574b-a490-4261-9569-e028dea8e7a2 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:29.424851 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'code': 200} Nov 15 12:46:29.453299 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:29.624993 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6658612b-b3ba-4a9b-9a3a-4a80748492c5 req-c03ad20b-02a1-466b-972f-7f7fdb382cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:29.626514 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6658612b-b3ba-4a9b-9a3a-4a80748492c5 req-c03ad20b-02a1-466b-972f-7f7fdb382cc4 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1098 time: 0.0408742 Nov 15 12:46:29.651688 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b305c520-1793-46ef-9a95-4b21c21ec23e req-de259923-11a6-488b-a174-fd9e800cc08a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:29.651688 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b305c520-1793-46ef-9a95-4b21c21ec23e req-de259923-11a6-488b-a174-fd9e800cc08a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0526938 Nov 15 12:46:29.679697 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6658612b-b3ba-4a9b-9a3a-4a80748492c5 req-da336cfd-05de-407a-98cc-7662810c8af8 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443597 Nov 15 12:46:29.708321 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b305c520-1793-46ef-9a95-4b21c21ec23e req-55044af9-991e-40fb-9046-8bb63fe30adc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478437 Nov 15 12:46:29.746864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba766954-b0d2-4452-92d6-ee0b392bc968 req-6473aa5f-334e-41e0-b6fe-8eac57dd0186 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:29.748431 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba766954-b0d2-4452-92d6-ee0b392bc968 req-6473aa5f-334e-41e0-b6fe-8eac57dd0186 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0691321 Nov 15 12:46:29.811891 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba766954-b0d2-4452-92d6-ee0b392bc968 req-6a55ebf4-b716-4bf4-80fd-b35b75fbbff2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558772 Nov 15 12:46:30.851212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad6ab8-216f-4f24-b46f-99991f6776d9 req-ced24e21-2d08-49ac-82bb-adcc776cd0f7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:30.852781 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-65ad6ab8-216f-4f24-b46f-99991f6776d9 req-ced24e21-2d08-49ac-82bb-adcc776cd0f7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0696054 Nov 15 12:46:30.912766 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-65ad6ab8-216f-4f24-b46f-99991f6776d9 req-b615fae8-53a5-498c-bbe8-be12be97aa05 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524728 Nov 15 12:46:30.956501 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef5ac9b-7204-49f8-a3cd-307d0bac5985 req-30cbb103-53ec-4d40-944b-90fbc4d24ed8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:30.958050 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5ef5ac9b-7204-49f8-a3cd-307d0bac5985 req-30cbb103-53ec-4d40-944b-90fbc4d24ed8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0617757 Nov 15 12:46:31.015865 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5ef5ac9b-7204-49f8-a3cd-307d0bac5985 req-6b9ca46c-4305-4d0d-bd21-8118f69c1af1 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461283 Nov 15 12:46:31.991803 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-317d628f-892a-461c-a33c-735ef353355f tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-294809760&fields=id&tenant_id=df44545940f44d95ad307aa0fea120c4 HTTP/1.1" status: 200 len: 267 time: 0.0439582 Nov 15 12:46:32.040028 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6757e80-5eb5-435f-a307-f781674a1668 req-dfcefaa4-10ca-41b7-80e0-2b96427dd344 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.041548 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b6757e80-5eb5-435f-a307-f781674a1668 req-dfcefaa4-10ca-41b7-80e0-2b96427dd344 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0591750 Nov 15 12:46:32.054080 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-30fcd19c-148d-45df-b49c-ab1a759e7e6d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.055565 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-30fcd19c-148d-45df-b49c-ab1a759e7e6d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 984 time: 0.0541646 Nov 15 12:46:32.067124 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Request body: {'port': {'security_groups': ['7af163f1-64de-46c1-89ce-501c6047dc35']}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:32.095755 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b6757e80-5eb5-435f-a307-f781674a1668 req-a96be145-7153-470c-868d-d8c29c210148 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479720 Nov 15 12:46:32.139594 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.209559 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8161ce5-a213-40db-b5a9-174b303a1b76 req-4647c828-289f-4334-af69-e912ca5ce3e5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.211095 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e8161ce5-a213-40db-b5a9-174b303a1b76 req-4647c828-289f-4334-af69-e912ca5ce3e5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0511723 Nov 15 12:46:32.260053 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e8161ce5-a213-40db-b5a9-174b303a1b76 req-d958ba5d-836a-40c6-b104-431ba6868180 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426466 Nov 15 12:46:32.316620 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:32.345709 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.350553 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.360989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512c172f-4727-4e00-b473-c505c1697811 req-ef2c5e3a-2715-4212-b731-4e2118ec2766 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.362513 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-512c172f-4727-4e00-b473-c505c1697811 req-ef2c5e3a-2715-4212-b731-4e2118ec2766 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0507514 Nov 15 12:46:32.375558 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55866) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:32.380247 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Request body: {'floatingip': {'port_id': 'f03748f1-6421-4492-82d3-c659e117188c'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:46:32.391311 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.392027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.393535 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d8ea5cfc-b033-47d3-a9a1-de53373abd0d req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "PUT /v2.0/ports/66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 942 time: 0.3310363 Nov 15 12:46:32.393999 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:32.396319 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-750bbf61-0343-4849-95c6-d4ac8d101566" -d '{"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:32.401246 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 55870) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:32.404470 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:46:32.451435 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1795c17c-3bdb-4b67-acf6-c502a28fe6a3 x-openstack-request-id: req-1795c17c-3bdb-4b67-acf6-c502a28fe6a3 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:32.451743 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:32.451969 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-1795c17c-3bdb-4b67-acf6-c502a28fe6a3 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:32.452919 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:46:32.459638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.467577 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911780cf-36e9-4c5a-8b64-5152c1f5a7ad tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event updated for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=7']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:32.509450 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.553286 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.629485 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:46:32.638647 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.642077 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.643361 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "DELETE /v2.0/security-groups/c1bab170-a392-46e1-87bf-5ff04474b15e HTTP/1.1" status: 204 len: 168 time: 0.2409897 Nov 15 12:46:32.653803 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55872) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:32.679521 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1607dc2e-17fb-4e02-a9d3-eb95c4bae1c2 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1bab170-a392-46e1-87bf-5ff04474b15e,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:32.753578 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-dfc4e79d-22c4-47e8-ae5c-68ec3c7b109a None None] Provisioning complete for port 66d80ca0-34c0-4ae9-a96c-a8004410e3af triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:46:32.753954 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-dfc4e79d-22c4-47e8-ae5c-68ec3c7b109a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:32.758281 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-9da5a561-bacf-4da6-a93e-7c7954cf27d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:32.760246 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-9da5a561-bacf-4da6-a93e-7c7954cf27d2 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1098 time: 0.1496801 Nov 15 12:46:33.323027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-6e4a7602-6261-4042-ac5f-37d544689648 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:33.324488 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-6e4a7602-6261-4042-ac5f-37d544689648 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.5351233 Nov 15 12:46:33.340846 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1e850c76-57d7-4507-8b6a-a27382620639 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.390842 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1738a7-0356-4e06-a3b3-65ae4a61d527 req-310f373c-7f59-413b-9c99-999acfa88c27 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:33.392530 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fb1738a7-0356-4e06-a3b3-65ae4a61d527 req-310f373c-7f59-413b-9c99-999acfa88c27 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0533264 Nov 15 12:46:33.431607 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-a35e7de4-0c2f-49cf-b162-7c02f26a32a6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 1000 time: 0.0984614 Nov 15 12:46:33.439879 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Deleting port 2639a22c-e6df-46f3-9ff3-c585c877575b {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:33.440241 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.442104 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-fb1738a7-0356-4e06-a3b3-65ae4a61d527 req-cbccbb42-7cfb-4d16-b4ee-41e9c2e61fa6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434144 Nov 15 12:46:33.511043 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.db.resource_extend [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 15 12:46:33.580150 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-77b8389b-6994-4657-8de1-ad60c1cfb6b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:33.581603 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-77b8389b-6994-4657-8de1-ad60c1cfb6b7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.1394982 Nov 15 12:46:33.583432 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.603501 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.685069 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.685391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:33.707627 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Calling delete_port for 2639a22c-e6df-46f3-9ff3-c585c877575b owned by network:floatingip {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:33.775274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-7bc13bc4-167e-4648-bf96-4aebb5b06ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:33.776688 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-7bc13bc4-167e-4648-bf96-4aebb5b06ef8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1847792 Nov 15 12:46:33.871388 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Floating IP 9ecb09d6-1e60-4edf-a022-0125934ee137 associated. External IP: 172.27.0.39, port: f03748f1-6421-4492-82d3-c659e117188c. Nov 15 12:46:34.016239 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-e961cf62-9a11-474f-abf0-b4f8bacd3c9f service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2267351 Nov 15 12:46:34.180429 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:34.226492 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event deleted for resources: {'Port': ['ID=2639a22c-e6df-46f3-9ff3-c585c877575b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:34.242469 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-750bbf61-0343-4849-95c6-d4ac8d101566 req-1cc6322d-aa69-4f12-9bc2-a1de5550b720 service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2186966 Nov 15 12:46:34.307136 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:46:34.311070 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks [] for floatingip, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:34.311390 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Floating IP c3872a6d-0405-43ca-827b-d5dfe4e3d95e disassociated (deleted). External IP: 172.27.0.96, port: 66d80ca0-34c0-4ae9-a96c-a8004410e3af. Nov 15 12:46:34.531857 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:46:34.542046 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:46:34.553034 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:34.553650 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:34.570612 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:34.626650 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dadffb5d-2a83-4e58-9492-6cb89473cd5a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "PUT /v2.0/floatingips/9ecb09d6-1e60-4edf-a022-0125934ee137 HTTP/1.1" status: 200 len: 990 time: 2.2499120 Nov 15 12:46:34.630029 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:34.632240 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d" -d '{"events": [{"name": "network-changed", "server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:34.660253 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba7fa09-7265-4f01-ba47-3798b7791411 req-e545b87e-9486-4f8c-b148-c872c5afb97b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:34.661763 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-dba7fa09-7265-4f01-ba47-3798b7791411 req-e545b87e-9486-4f8c-b148-c872c5afb97b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1323848 Nov 15 12:46:34.673165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:34.698682 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:46:34.736672 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-dba7fa09-7265-4f01-ba47-3798b7791411 req-99b9e700-0fc3-42f4-bb71-3467396ec030 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0659888 Nov 15 12:46:34.793033 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50d88658-12ed-4985-b707-a32cd7f06ccb x-openstack-request-id: req-50d88658-12ed-4985-b707-a32cd7f06ccb {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:34.793327 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:34.793577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-50d88658-12ed-4985-b707-a32cd7f06ccb {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:34.794152 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'status': 'completed', 'code': 200} Nov 15 12:46:34.835537 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:46:34.840638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:34.852222 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Sync routers for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:46:34.863156 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:34.863755 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:34.949394 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '9ecb09d6-1e60-4edf-a022-0125934ee137', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.39', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:46:19Z', 'updated_at': '2021-11-15T12:46:33Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:34.975874 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:34.981615 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:46:34.991855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:34.992429 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:35.105839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:35.162929 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3e12048e-4014-4feb-b4aa-c421afb91433 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "DELETE /v2.0/floatingips/c3872a6d-0405-43ca-827b-d5dfe4e3d95e HTTP/1.1" status: 204 len: 168 time: 2.5056729 Nov 15 12:46:35.193312 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-f9c94488-3d21-46db-a17d-b7cae2424e03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:35.194924 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-f9c94488-3d21-46db-a17d-b7cae2424e03 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1098 time: 0.3285813 Nov 15 12:46:35.332902 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:35.354601 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-f1e98b9c-79b6-4ee9-952d-a81c34be928b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:35.356421 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-f1e98b9c-79b6-4ee9-952d-a81c34be928b service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.1471899 Nov 15 12:46:35.365484 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Checking router: 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:46:35.376781 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:35.378062 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:35.469022 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-f4a3797d-9733-46e7-89c8-0b871cc049f4 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 998 time: 0.1006587 Nov 15 12:46:35.561293 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:35.564903 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-86e047ad-bc12-4186-8dff-45648a0ba85e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:35.567085 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-86e047ad-bc12-4186-8dff-45648a0ba85e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0830886 Nov 15 12:46:35.571337 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '9ecb09d6-1e60-4edf-a022-0125934ee137', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.39', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:46:19Z', 'updated_at': '2021-11-15T12:46:33Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:35.654038 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-90893ccc-ceac-43fd-b3c0-efe870a8124b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:35.664175 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-90893ccc-ceac-43fd-b3c0-efe870a8124b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0785575 Nov 15 12:46:35.766109 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0abe766-14c3-427d-9307-465d49ca35f8 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '9ecb09d6-1e60-4edf-a022-0125934ee137', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'floating_ip_address': '172.27.0.39', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:46:19Z', 'updated_at': '2021-11-15T12:46:33Z', 'revision_number': 1, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:46:35.787083 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4339d8c3-0206-421a-a34f-c0156b379c68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:35.812368 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-46a9f7a7-cc80-410a-b581-7c2504c18ee6 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1423974 Nov 15 12:46:35.895579 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:35.927226 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8306b0f8-f57e-4553-bb7d-50180299fb39 None None] The sync data for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi is: [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:42:35Z', 'revision_number': 4, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': 'c059cff6-5437-48af-86c1-04fb20919292', 'name': '', 'network_id': '63821a5d-1e37-42d5-95f6-37a0a7410c6f', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'mac_address': 'fa:16:3e:51:e1:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_interface', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:34Z', 'updated_at': '2021-11-15T12:42:43Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'subnets': [{'id': '090fdaf0-419e-4969-a548-0e896cf59fa0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:46:35.965311 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682d2b53-a29a-4b6c-a12e-1630afbf35d8 req-76e1c8d4-016e-459b-b38e-a0aad1493245 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:35.966911 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-682d2b53-a29a-4b6c-a12e-1630afbf35d8 req-76e1c8d4-016e-459b-b38e-a0aad1493245 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0837629 Nov 15 12:46:35.969123 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3cbb861d-9d89-4ff8-bd6b-2fbb5e27f98d req-7d2c14b7-3b19-4281-963b-8666fdcb521a service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1469324 Nov 15 12:46:36.034137 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-682d2b53-a29a-4b6c-a12e-1630afbf35d8 req-3f0c409f-5dda-4226-94e1-078b4d7b81f3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0597186 Nov 15 12:46:36.081193 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c60cdab-37f3-455a-907b-fdbbfa06eed9 None None] New status for floating IP 9ecb09d6-1e60-4edf-a022-0125934ee137: ACTIVE {{(pid=108288) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:46:36.276935 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ff96de-eb96-4b31-b874-179d6ea3bcbd None None] New status for floating IP c3872a6d-0405-43ca-827b-d5dfe4e3d95e: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:46:36.795458 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:36.798327 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f95960a-71ec-4673-a8ae-1f55b80302de" -d '{"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:36.834379 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d473c06b-32ef-43ad-9580-1eb45d9e809b x-openstack-request-id: req-d473c06b-32ef-43ad-9580-1eb45d9e809b {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:36.834666 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:36.834914 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-d473c06b-32ef-43ad-9580-1eb45d9e809b {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:36.835309 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:46:36.869472 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:36.928577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b31f8015-54cd-4bc8-8682-dabc25ba1af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:36.930060 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b31f8015-54cd-4bc8-8682-dabc25ba1af5 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=df44545940f44d95ad307aa0fea120c4&device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 1098 time: 0.0416424 Nov 15 12:46:37.039177 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b052b633-5c71-4204-b9b3-532364006107 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:37.040798 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b052b633-5c71-4204-b9b3-532364006107 service neutron] 10.222.0.61 "GET /v2.0/networks?id=63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 200 len: 914 time: 0.1000719 Nov 15 12:46:37.085768 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-069072ba-e392-496e-ab0f-d762a50c9fa6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 200 len: 217 time: 0.0354102 Nov 15 12:46:37.167648 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b271a620-f6cd-4c3a-ae43-d3b2919e30ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:37.169118 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-b271a620-f6cd-4c3a-ae43-d3b2919e30ee service neutron] 10.222.0.61 "GET /v2.0/subnets?id=090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 200 len: 852 time: 0.0737240 Nov 15 12:46:37.194403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d41eee3-c271-418a-a71a-4ac095aa7dac req-1dc03a04-8000-48a1-87f6-136f73b73abb tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:37.195844 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6d41eee3-c271-418a-a71a-4ac095aa7dac req-1dc03a04-8000-48a1-87f6-136f73b73abb tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0702405 Nov 15 12:46:37.249690 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-d9c10547-2f81-4760-bc5a-7503a460583e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:37.251167 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-d9c10547-2f81-4760-bc5a-7503a460583e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=63821a5d-1e37-42d5-95f6-37a0a7410c6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0734510 Nov 15 12:46:37.278780 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6d41eee3-c271-418a-a71a-4ac095aa7dac req-7be3a156-95b6-43e3-9bf3-419646e2d728 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686712 Nov 15 12:46:37.347067 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-77402341-5971-4e0f-b2dd-832c107fd95b service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883999 Nov 15 12:46:37.435745 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f95960a-71ec-4673-a8ae-1f55b80302de req-407744b5-550b-4947-a8dd-8708715a1d5d service neutron] 10.222.0.61 "GET /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812781 Nov 15 12:46:38.339335 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:38.400981 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1542b05-2b5f-4cad-836c-809ff822bb5e req-da5b0523-00d6-4b19-a380-b34e09c932e8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:38.402478 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c1542b05-2b5f-4cad-836c-809ff822bb5e req-da5b0523-00d6-4b19-a380-b34e09c932e8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0541923 Nov 15 12:46:38.449711 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c1542b05-2b5f-4cad-836c-809ff822bb5e req-d3d3ecd4-9f05-445f-8971-99e7278bef73 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407131 Nov 15 12:46:39.125844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:39.145454 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732879af-b95e-4810-8d9d-c0ba361e256b req-288306f0-f828-4b8c-999a-a97aebdb5fdb tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:39.147013 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-732879af-b95e-4810-8d9d-c0ba361e256b req-288306f0-f828-4b8c-999a-a97aebdb5fdb tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0645130 Nov 15 12:46:39.197108 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-732879af-b95e-4810-8d9d-c0ba361e256b req-95e624de-9899-41ff-bf8c-fae6e9d04861 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440671 Nov 15 12:46:39.568099 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b0c6a6-547e-4dd0-8367-9d0bd5baa045 req-27bc4514-ae16-4880-908a-db9b2bddc791 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:39.570086 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94b0c6a6-547e-4dd0-8367-9d0bd5baa045 req-27bc4514-ae16-4880-908a-db9b2bddc791 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0509253 Nov 15 12:46:39.622452 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94b0c6a6-547e-4dd0-8367-9d0bd5baa045 req-bb8cdaf7-a6b3-4527-add8-98d85a4669d5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463164 Nov 15 12:46:40.317095 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea9b8918-9df0-49d9-a9f1-e6faa6bed115 req-02fb68a8-b789-40a2-a77f-cd493f784511 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:40.318646 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ea9b8918-9df0-49d9-a9f1-e6faa6bed115 req-02fb68a8-b789-40a2-a77f-cd493f784511 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0496101 Nov 15 12:46:40.371593 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ea9b8918-9df0-49d9-a9f1-e6faa6bed115 req-ac7078b9-e3ae-473f-b190-8207675199a9 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469284 Nov 15 12:46:40.747694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e5a243-78e9-433d-8213-fd7c37530747 req-5f7544a7-ff22-4ea0-8e8b-bd614a8ed6a8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:40.749273 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-72e5a243-78e9-433d-8213-fd7c37530747 req-5f7544a7-ff22-4ea0-8e8b-bd614a8ed6a8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0570016 Nov 15 12:46:40.799444 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-72e5a243-78e9-433d-8213-fd7c37530747 req-0ea4237d-5a22-4080-9516-012296578a60 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440104 Nov 15 12:46:41.168248 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-c0828aaf-3c92-4c44-b88e-b7bd0bdc904e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:41.169703 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-c0828aaf-3c92-4c44-b88e-b7bd0bdc904e tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.61 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.0536442 Nov 15 12:46:41.261344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Deleting port 66d80ca0-34c0-4ae9-a96c-a8004410e3af {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:41.261673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:41.352608 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] For port 66d80ca0-34c0-4ae9-a96c-a8004410e3af, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=66d80ca0-34c0-4ae9-a96c-a8004410e3af,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:41.352961 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:41.364999 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Calling delete_port for 66d80ca0-34c0-4ae9-a96c-a8004410e3af owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:41.526307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:41.566328 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5907167c-9f15-47cf-b20e-494b14c1724f req-c63928a7-dd79-4584-900b-58dee8c6e688 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:41.566795 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['66d80ca0-34c0-4ae9-a96c-a8004410e3af'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:46:41.567874 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5907167c-9f15-47cf-b20e-494b14c1724f req-c63928a7-dd79-4584-900b-58dee8c6e688 tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/ports?device_id=4f1d7e17-aaa1-4ac3-bac1-d8afae46170b HTTP/1.1" status: 200 len: 945 time: 0.1197340 Nov 15 12:46:41.570474 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Pushing event deleted for resources: {'Port': ['ID=66d80ca0-34c0-4ae9-a96c-a8004410e3af,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:41.632689 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] No DVR routers for this DVR port 66d80ca0-34c0-4ae9-a96c-a8004410e3af on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:41.636036 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:41.642114 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7367c3ba-45bd-4b88-b7c1-7e017d7088e0 req-e96d984c-0a7d-4a07-9dcc-9312ce64145a tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.61 "DELETE /v2.0/ports/66d80ca0-34c0-4ae9-a96c-a8004410e3af HTTP/1.1" status: 204 len: 173 time: 0.4634304 Nov 15 12:46:41.642114 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'name': 'network-vif-deleted', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:46:41.642625 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58a453ed-9d37-41ad-b693-68ba071003a7" -d '{"events": [{"server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "name": "network-vif-deleted", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:46:41.672323 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5907167c-9f15-47cf-b20e-494b14c1724f req-6828c2f7-5845-47e2-99bc-901e306cde2d tempest-TestMinimumBasicScenario-1959903551 tempest-TestMinimumBasicScenario-1959903551-project] 10.222.0.44 "GET /v2.0/security-groups?id=7af163f1-64de-46c1-89ce-501c6047dc35&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914061 Nov 15 12:46:41.690866 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:46:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-825464cb-02e3-4a45-a511-64518500d8a4 x-openstack-request-id: req-825464cb-02e3-4a45-a511-64518500d8a4 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:46:41.691170 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f1d7e17-aaa1-4ac3-bac1-d8afae46170b", "name": "network-vif-deleted", "tag": "66d80ca0-34c0-4ae9-a96c-a8004410e3af", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:46:41.691415 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-825464cb-02e3-4a45-a511-64518500d8a4 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:46:41.691817 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f1d7e17-aaa1-4ac3-bac1-d8afae46170b', 'name': 'network-vif-deleted', 'tag': '66d80ca0-34c0-4ae9-a96c-a8004410e3af', 'status': 'completed', 'code': 200} Nov 15 12:46:41.935510 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922393a8-eba2-4349-8730-90294b537506 req-23aec69e-762d-4c96-9a56-76c05e7b70d5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:41.937409 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-922393a8-eba2-4349-8730-90294b537506 req-23aec69e-762d-4c96-9a56-76c05e7b70d5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0599835 Nov 15 12:46:41.988355 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-922393a8-eba2-4349-8730-90294b537506 req-b1067979-dea1-4664-b785-399eb32eb8cd tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444505 Nov 15 12:46:43.150555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1b8cde-6e61-4eee-989c-007c125755a6 req-e63c6a26-e1ba-4d9c-83cd-bcb43e067f38 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:43.152256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bc1b8cde-6e61-4eee-989c-007c125755a6 req-e63c6a26-e1ba-4d9c-83cd-bcb43e067f38 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0828125 Nov 15 12:46:43.225649 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bc1b8cde-6e61-4eee-989c-007c125755a6 req-f6d713f3-ffb0-4702-87b8-ee2cd3259723 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0665870 Nov 15 12:46:43.477365 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 55992) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:43.837126 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.074918 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.081131 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Deleting port c059cff6-5437-48af-86c1-04fb20919292 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:44.081480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.159889 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] For port c059cff6-5437-48af-86c1-04fb20919292, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c059cff6-5437-48af-86c1-04fb20919292,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:44.160592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.173450 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Calling delete_port for c059cff6-5437-48af-86c1-04fb20919292 owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:44.388217 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0282d035-89a5-4c24-acb7-c23bd9798111 req-247d2323-11bb-4613-b2b7-5ed039f4e093 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:44.389640 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0282d035-89a5-4c24-acb7-c23bd9798111 req-247d2323-11bb-4613-b2b7-5ed039f4e093 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0872157 Nov 15 12:46:44.443916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.484786 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Pushing event deleted for resources: {'Port': ['ID=c059cff6-5437-48af-86c1-04fb20919292,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:44.496472 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-f5540aad-b940-4795-8646-0a29035394cf service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1472011 Nov 15 12:46:44.501899 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0282d035-89a5-4c24-acb7-c23bd9798111 req-bd6cbcac-d3aa-49be-a60c-856e4e4445be tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0949373 Nov 15 12:46:44.658003 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e15847-cddd-483b-9c95-56e29ce29bba req-05acc2b9-f521-4cbd-9617-c15a922ca9eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:44.659465 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-05acc2b9-f521-4cbd-9617-c15a922ca9eb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 1098 time: 0.1158903 Nov 15 12:46:44.745912 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:44.856215 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e15847-cddd-483b-9c95-56e29ce29bba req-a83ed05d-297a-4e77-ab1b-020e6bc359f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:44.857702 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-a83ed05d-297a-4e77-ab1b-020e6bc359f7 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.1740203 Nov 15 12:46:45.009737 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-b450c8ea-2386-4e54-9862-a845df2d1899 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 HTTP/1.1" status: 200 len: 1001 time: 0.1334884 Nov 15 12:46:45.087387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e15847-cddd-483b-9c95-56e29ce29bba req-278da3be-6f24-4603-aa27-55f76595174b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:45.088855 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-278da3be-6f24-4603-aa27-55f76595174b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0612462 Nov 15 12:46:45.090563 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:46:45.208537 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e15847-cddd-483b-9c95-56e29ce29bba req-ba97ec2e-5608-4505-a1f4-2c9938725b8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:45.210025 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-ba97ec2e-5608-4505-a1f4-2c9938725b8a service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1084998 Nov 15 12:46:45.232518 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:46:45.238182 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-0a95ab24-8e5c-46d6-8eff-2ff05aa4cd59 admin admin] 10.222.0.44 "PUT /v2.0/routers/6ae5861d-cdb6-4c9e-afbb-483dcc64cafb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7594538 Nov 15 12:46:45.240977 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56000) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:45.244712 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Sync routers for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:46:45.256276 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:45.256886 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:45.296627 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 66d80ca0-34c0-4ae9-a96c-a8004410e3af no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:45.327005 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-139ed46d-4ca8-48d5-8b88-4d4507c3d098 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1036487 Nov 15 12:46:45.349499 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 66d80ca0-34c0-4ae9-a96c-a8004410e3af {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:45.349827 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 66d80ca0-34c0-4ae9-a96c-a8004410e3af not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:45.360654 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks [] for router, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:45.406298 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:45.477117 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94e15847-cddd-483b-9c95-56e29ce29bba req-1f0fed9f-242f-47f2-9a6c-a276d7483891 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403990 Nov 15 12:46:45.512360 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:45.569200 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Deleting port 46a51869-abfe-44bd-b87c-081fd3737c29 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:45.569544 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:45.612155 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21'}], 'enable_snat': True}, 'gw_port_id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:46:44Z', 'revision_number': 5, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port': {'id': '46a51869-abfe-44bd-b87c-081fd3737c29', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:9e:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:28Z', 'updated_at': '2021-11-15T12:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:45.638910 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e86ef01-4570-44b4-b0f3-4bfff74c313e req-2cd6c1ca-ee05-4336-8732-475af467eda4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:45.639322 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Checking router: 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:46:45.641258 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6e86ef01-4570-44b4-b0f3-4bfff74c313e req-2cd6c1ca-ee05-4336-8732-475af467eda4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0594122 Nov 15 12:46:45.648800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Routers {'6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:45.649323 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:45.663694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] For port 46a51869-abfe-44bd-b87c-081fd3737c29, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=46a51869-abfe-44bd-b87c-081fd3737c29,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:45.664526 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:45.677672 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Calling delete_port for 46a51869-abfe-44bd-b87c-081fd3737c29 owned by network:router_gateway {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:45.691727 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6e86ef01-4570-44b4-b0f3-4bfff74c313e req-de53c9ea-31b5-4ea1-9dc5-96ae24303f15 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438931 Nov 15 12:46:45.739842 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] Set router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb gateway port host: None {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:45.793741 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:46:45Z', 'revision_number': 6, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:45.819711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d333f4-8bc4-4946-8aff-8204f1a5ef8e None None] The sync data for ids ['6ae5861d-cdb6-4c9e-afbb-483dcc64cafb'] in dv-cinder-803823-7-iscsi is: [{'id': '6ae5861d-cdb6-4c9e-afbb-483dcc64cafb', 'name': 'tempest-TestMinimumBasicScenario-77328814-router', 'tenant_id': 'df44545940f44d95ad307aa0fea120c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:27Z', 'updated_at': '2021-11-15T12:46:45Z', 'revision_number': 6, 'project_id': 'df44545940f44d95ad307aa0fea120c4', 'gw_port_host': None}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:46:45.855149 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:45.884460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Pushing event deleted for resources: {'Port': ['ID=46a51869-abfe-44bd-b87c-081fd3737c29,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:45.945178 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.048044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.050798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.369111 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.369847 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6ae5861d-cdb6-4c9e-afbb-483dcc64cafb {{(pid=108287) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:46:46.374943 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.375932 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b1c22d97-ccb4-459e-b059-d89cc6880e5a admin admin] 10.222.0.44 "DELETE /v2.0/routers/6ae5861d-cdb6-4c9e-afbb-483dcc64cafb HTTP/1.1" status: 204 len: 168 time: 1.1333971 Nov 15 12:46:46.378474 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56006) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:46.421217 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Deleting subnet 090fdaf0-419e-4969-a548-0e896cf59fa0 {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:46:46.424199 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.467009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.572247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.624867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.647059 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=090fdaf0-419e-4969-a548-0e896cf59fa0,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:46.656397 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.659655 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5464e340-a1a6-49bd-8d7c-bb5e372e7674 None None] Network 63821a5d-1e37-42d5-95f6-37a0a7410c6f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:46:46.662473 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/090fdaf0-419e-4969-a548-0e896cf59fa0 HTTP/1.1" status: 204 len: 168 time: 0.2829683 Nov 15 12:46:46.662924 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56008) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:46.665217 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.665567 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.665907 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.666240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.666571 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.666903 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.667235 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.667563 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.667884 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.668269 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.668550 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.668870 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb986bcd-dde3-4404-937a-382e183ed007 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:46.738760 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.765875 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c059cff6-5437-48af-86c1-04fb20919292 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:46.810655 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: c059cff6-5437-48af-86c1-04fb20919292 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:46.811025 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c059cff6-5437-48af-86c1-04fb20919292 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:46.811476 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 46a51869-abfe-44bd-b87c-081fd3737c29 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:46.837107 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Deleting port 3b9f2eb7-e122-4958-aa71-a69abf322351 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:46.839018 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.847425 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 46a51869-abfe-44bd-b87c-081fd3737c29 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:46.847749 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 46a51869-abfe-44bd-b87c-081fd3737c29 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:46.895948 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0e0b94-a1c5-4309-ad47-adea0ae025d4 req-676a2d8b-5cf5-4265-a500-67eb07a6ed4d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:46.895948 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b0e0b94-a1c5-4309-ad47-adea0ae025d4 req-676a2d8b-5cf5-4265-a500-67eb07a6ed4d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1165495 Nov 15 12:46:46.935820 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] For port 3b9f2eb7-e122-4958-aa71-a69abf322351, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=3b9f2eb7-e122-4958-aa71-a69abf322351,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:46.936220 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:46.936855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] DHCP port deletion for 63821a5d-1e37-42d5-95f6-37a0a7410c6f request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:46:46.996468 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Deleting port 3b9f2eb7-e122-4958-aa71-a69abf322351 {{(pid=108288) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:46.996876 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.064015 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] For port 3b9f2eb7-e122-4958-aa71-a69abf322351, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=3b9f2eb7-e122-4958-aa71-a69abf322351,segment=NetworkSegment(af347650-18c7-458f-a0a0-a0ae25ae52ca),segment_id=af347650-18c7-458f-a0a0-a0ae25ae52ca)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:47.064467 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.078567 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Calling delete_port for 3b9f2eb7-e122-4958-aa71-a69abf322351 owned by network:dhcp {{(pid=108288) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:47.196819 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031'] for port, after_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.206013 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Calling delete_port for 3b9f2eb7-e122-4958-aa71-a69abf322351 owned by network:dhcp {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:47.222690 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] Pushing event deleted for resources: {'Port': ['ID=3b9f2eb7-e122-4958-aa71-a69abf322351,revision_number=None']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:47.227693 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6871583-e3fd-43e2-a8f6-0b733a177174 None None] No DVR routers for this DVR port 3b9f2eb7-e122-4958-aa71-a69abf322351 on host dv-cinder-803823-7-iscsi {{(pid=108288) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:47.228533 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7b0e0b94-a1c5-4309-ad47-adea0ae025d4 req-0527fe63-9a95-4ada-a1fc-e7955cf2c442 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3253424 Nov 15 12:46:47.305159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.329596 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b9f2eb7-e122-4958-aa71-a69abf322351,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:47.333848 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] No DVR routers for this DVR port 3b9f2eb7-e122-4958-aa71-a69abf322351 on host dv-cinder-803823-7-iscsi {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:47.363006 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.363338 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.363678 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.364005 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.364351 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.364674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.364992 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.365314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.365630 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.365942 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.366252 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.366563 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:46:47.418555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.442650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63821a5d-1e37-42d5-95f6-37a0a7410c6f']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:47.451325 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af347650-18c7-458f-a0a0-a0ae25ae52ca') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:47.451557 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af347650-18c7-458f-a0a0-a0ae25ae52ca') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:47.460918 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.473856 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.479495 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Releasing vlan 601 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:46:47.479867 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self.session.flush() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self.session.flush() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self.session.flush() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self.session.flush() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:46:47.481504 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:46:47.540307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.547195 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:47.550418 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] 10.222.0.44 "DELETE /v2.0/networks/63821a5d-1e37-42d5-95f6-37a0a7410c6f HTTP/1.1" status: 204 len: 168 time: 0.8864367 Nov 15 12:46:47.553512 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56014) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:47.564256 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14059937-5892-4a51-8cea-01e1832d1732 admin admin] Pushing event deleted for resources: {'Network': ['ID=63821a5d-1e37-42d5-95f6-37a0a7410c6f,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:47.986606 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:48.284256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Deleting port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:48.284776 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:48.351463 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63314a4e-d622-47cc-94b1-94811fcd2677 req-a7395399-150b-41de-96ee-c449956df7b7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:48.352967 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63314a4e-d622-47cc-94b1-94811fcd2677 req-a7395399-150b-41de-96ee-c449956df7b7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0497463 Nov 15 12:46:48.377399 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] For port eaaa6061-3a7a-41d0-ac7b-b1f20ee16305, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:48.377785 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:48.392546 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Calling delete_port for eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 owned by network:router_interface {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:48.417090 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63314a4e-d622-47cc-94b1-94811fcd2677 req-72b1c445-f381-4fc3-a880-c8d7344fc11b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574217 Nov 15 12:46:48.596818 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:48.622863 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Pushing event deleted for resources: {'Port': ['ID=eaaa6061-3a7a-41d0-ac7b-b1f20ee16305,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:48.729993 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae611177-06ef-4eaf-b3f2-90f68b2ee467 req-12c2d365-bb52-4b23-a589-ab45f1be75ca tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:48.732575 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ae611177-06ef-4eaf-b3f2-90f68b2ee467 req-12c2d365-bb52-4b23-a589-ab45f1be75ca tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0851662 Nov 15 12:46:48.851387 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 3b9f2eb7-e122-4958-aa71-a69abf322351 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:48.859564 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-f4e3971e-ea36-44a7-9992-f769d446fabc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:48.861502 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-f4e3971e-ea36-44a7-9992-f769d446fabc service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1099 time: 0.0702827 Nov 15 12:46:48.881286 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 3b9f2eb7-e122-4958-aa71-a69abf322351 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:48.881630 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 3b9f2eb7-e122-4958-aa71-a69abf322351 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:48.887923 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ae611177-06ef-4eaf-b3f2-90f68b2ee467 req-8c84f9e7-09c7-492c-b5aa-eadf19410938 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1488993 Nov 15 12:46:48.918703 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:48.998391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-d0cdcbd7-84bc-4731-9e20-9eba114369b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:49.000032 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-d0cdcbd7-84bc-4731-9e20-9eba114369b4 service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1278462 Nov 15 12:46:49.076574 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-565b1049-c882-45b4-b474-b1352ee6bbe8 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 1001 time: 0.0648506 Nov 15 12:46:49.147736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:46:49.152432 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-7700fc49-e18f-403e-b8fc-40db22d125f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:49.153890 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-7700fc49-e18f-403e-b8fc-40db22d125f4 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0682945 Nov 15 12:46:49.202663 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-5ea291cd-72a6-42f6-ab26-7dffaa875e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:49.204158 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-5ea291cd-72a6-42f6-ab26-7dffaa875e72 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418537 Nov 15 12:46:49.256881 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:46:49.261916 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fd9d1441-42a3-4f73-8be4-7b5ae312e4ba admin admin] 10.222.0.44 "PUT /v2.0/routers/0a6e69d4-a625-4ad8-acb4-410cc32f6e75/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7068059 Nov 15 12:46:49.264568 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56024) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:49.268192 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Sync routers for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:46:49.278392 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:49.279443 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:49.307256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-c5add0b8-3d4f-4a58-85c6-8d1e3adb748c service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949733 Nov 15 12:46:49.366864 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks [] for router, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:49.391224 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:49.408279 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e03e140f-a2fe-4685-9f5b-dcb16a92325a req-d56421e2-d6cd-4d65-9f49-40893c07116f service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922606 Nov 15 12:46:49.474408 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:49.542196 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Deleting port 23721e28-1c53-411d-bdd5-b7abe13ce659 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:49.542595 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:49.578850 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235'}], 'enable_snat': True}, 'gw_port_id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:46:48Z', 'revision_number': 5, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port': {'id': '23721e28-1c53-411d-bdd5-b7abe13ce659', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:21:59:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'device_owner': 'network:router_gateway', 'standard_attr_id': 425, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.235', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:43Z', 'updated_at': '2021-11-15T12:42:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:49.609003 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Checking router: 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:46:49.618724 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Routers {'0a6e69d4-a625-4ad8-acb4-410cc32f6e75'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:46:49.619291 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:46:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:49.639212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] For port 23721e28-1c53-411d-bdd5-b7abe13ce659, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=23721e28-1c53-411d-bdd5-b7abe13ce659,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:49.640461 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:49.658325 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Calling delete_port for 23721e28-1c53-411d-bdd5-b7abe13ce659 owned by network:router_gateway {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:49.712582 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] Set router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:46:49.770964 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:46:49Z', 'revision_number': 6, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:49.814917 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22a22b87-9b7d-4c77-bacf-68f1d7bd8f57 None None] The sync data for ids ['0a6e69d4-a625-4ad8-acb4-410cc32f6e75'] in dv-cinder-803823-7-iscsi is: [{'id': '0a6e69d4-a625-4ad8-acb4-410cc32f6e75', 'name': 'tempest-TestMinimumBasicScenario-945489215-router', 'tenant_id': '9ab16627a6404e7e9735d089a2febe78', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:41Z', 'updated_at': '2021-11-15T12:46:49Z', 'revision_number': 6, 'project_id': '9ab16627a6404e7e9735d089a2febe78', 'gw_port_host': None}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:46:49.858154 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:49.885185 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Pushing event deleted for resources: {'Port': ['ID=23721e28-1c53-411d-bdd5-b7abe13ce659,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:49.953302 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.335051 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.338354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.391502 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db20eab-68bb-4b9b-8d3d-6af8be1ee0c0 req-88a55cb4-7c7c-42d6-b099-e4e0cf648504 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:50.393066 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2db20eab-68bb-4b9b-8d3d-6af8be1ee0c0 req-88a55cb4-7c7c-42d6-b099-e4e0cf648504 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.4118683 Nov 15 12:46:50.398412 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.398974 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0a6e69d4-a625-4ad8-acb4-410cc32f6e75 {{(pid=108287) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:46:50.403388 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.408811 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-042e55df-8cf5-483c-b77b-061a01cb392e admin admin] 10.222.0.44 "DELETE /v2.0/routers/0a6e69d4-a625-4ad8-acb4-410cc32f6e75 HTTP/1.1" status: 204 len: 168 time: 1.1390171 Nov 15 12:46:50.409277 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56030) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:50.451506 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2db20eab-68bb-4b9b-8d3d-6af8be1ee0c0 req-071ec0da-0c3c-4725-a3dc-053e30fcf659 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455229 Nov 15 12:46:50.462465 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Deleting subnet 6efd7478-ea59-4576-b80a-5a4beb76d983 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:46:50.466173 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.505579 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.606469 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.669439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.695959 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6efd7478-ea59-4576-b80a-5a4beb76d983,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:50.699631 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.703643 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-54a1ecae-1796-4f63-b169-29b6ab865c60 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/6efd7478-ea59-4576-b80a-5a4beb76d983 HTTP/1.1" status: 204 len: 168 time: 0.2928543 Nov 15 12:46:50.706040 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56034) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:50.706499 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-873bd46d-e5e0-4f92-908a-b1a5d3b12af6 None None] Network d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:46:50.784297 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:50.803191 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.825259 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:50.825795 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device eaaa6061-3a7a-41d0-ac7b-b1f20ee16305 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:50.826151 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 23721e28-1c53-411d-bdd5-b7abe13ce659 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:50.865126 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 23721e28-1c53-411d-bdd5-b7abe13ce659 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:50.865457 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 23721e28-1c53-411d-bdd5-b7abe13ce659 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:46:50.867042 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Deleting port 627d232e-598f-447d-b086-8c7a0a11aea5 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:50.867200 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.940297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] For port 627d232e-598f-447d-b086-8c7a0a11aea5, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=627d232e-598f-447d-b086-8c7a0a11aea5,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:50.940748 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:50.956057 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Calling delete_port for 627d232e-598f-447d-b086-8c7a0a11aea5 owned by network:dhcp {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:50.970909 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] DHCP port deletion for d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:46:51.028495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Deleting port 627d232e-598f-447d-b086-8c7a0a11aea5 {{(pid=108288) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:46:51.028979 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.055884 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.082396 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=627d232e-598f-447d-b086-8c7a0a11aea5,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:51.085820 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] No DVR routers for this DVR port 627d232e-598f-447d-b086-8c7a0a11aea5 on host dv-cinder-803823-7-iscsi {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:51.102280 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] For port 627d232e-598f-447d-b086-8c7a0a11aea5, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=627d232e-598f-447d-b086-8c7a0a11aea5,segment=NetworkSegment(162eb35d-70e4-43af-a8e2-2e32e5bf12e0),segment_id=162eb35d-70e4-43af-a8e2-2e32e5bf12e0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:46:51.102843 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.116772 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Calling delete_port for 627d232e-598f-447d-b086-8c7a0a11aea5 owned by network:dhcp {{(pid=108288) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:46:51.160980 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.182780 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:51.198110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '162eb35d-70e4-43af-a8e2-2e32e5bf12e0') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:51.198460 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '162eb35d-70e4-43af-a8e2-2e32e5bf12e0') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:46:51.205460 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031'] for port, after_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.212448 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.231928 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.234763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] Pushing event deleted for resources: {'Port': ['ID=627d232e-598f-447d-b086-8c7a0a11aea5,revision_number=None']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:51.240206 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Releasing vlan 639 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:46:51.240391 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5228aa79-62e9-497d-a3c9-c70178a4f1ba None None] No DVR routers for this DVR port 627d232e-598f-447d-b086-8c7a0a11aea5 on host dv-cinder-803823-7-iscsi {{(pid=108288) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:46:51.241001 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:46:51.243859 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:46:51.302361 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.307536 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.310701 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] 10.222.0.44 "DELETE /v2.0/networks/d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6 HTTP/1.1" status: 204 len: 168 time: 0.6035509 Nov 15 12:46:51.323042 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c99a3b-aa4b-40d9-9c29-84b4ee25d8e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=d4aeb5a7-8b26-4fee-94f1-32dc4233e0f6,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:51.481254 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56040) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:51.521808 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5bc88543-4278-4908-9050-08694c1f9e48 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=df44545940f44d95ad307aa0fea120c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0403631 Nov 15 12:46:51.524382 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56042) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:51.574015 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.576247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab79555-61e4-433b-8112-7858f08e067c req-aaa477a6-1ddd-4321-bbfa-d50c4c752905 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:46:51.577782 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dab79555-61e4-433b-8112-7858f08e067c req-aaa477a6-1ddd-4321-bbfa-d50c4c752905 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0512629 Nov 15 12:46:51.596290 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.626247 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dab79555-61e4-433b-8112-7858f08e067c req-77dff0af-199f-4309-bbc7-ccd3a83f4972 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424719 Nov 15 12:46:51.653250 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.655790 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:51.656950 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/7af163f1-64de-46c1-89ce-501c6047dc35 HTTP/1.1" status: 204 len: 168 time: 0.1316178 Nov 15 12:46:51.665182 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f66478-2dd6-4041-af70-8183fa50be96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7af163f1-64de-46c1-89ce-501c6047dc35,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:52.009565 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56052) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:52.050131 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-376bc6b4-9bd1-4395-adea-d06b27de70bd admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=9ab16627a6404e7e9735d089a2febe78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0394225 Nov 15 12:46:52.052671 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56054) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:46:52.098724 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:52.119420 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:52.166806 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:52.170060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:46:52.171414 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/f04dbfa8-cb37-4470-9477-7cdec21c826f HTTP/1.1" status: 204 len: 168 time: 0.1177473 Nov 15 12:46:52.180524 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69c9d85-7d91-4e3d-aa08-d5de663735ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f04dbfa8-cb37-4470-9477-7cdec21c826f,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:46:52.736714 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 627d232e-598f-447d-b086-8c7a0a11aea5 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:46:52.756524 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 627d232e-598f-447d-b086-8c7a0a11aea5 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:46:52.756847 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 627d232e-598f-447d-b086-8c7a0a11aea5 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:47:03.346937 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2f7f1a3f-b7e8-45f6-832c-e352cb329e34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:03.764107 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:47:05.769285 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-40291181-a070-4521-9883-60a98285e1d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:06.872911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:08.342171 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:09.128914 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:14.075558 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:15.730629 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b00386e-49fd-4cc2-a37f-65f6ccc66af8 req-d5f23f03-11cf-4f0e-a3cb-2abdd236a88d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:15.732261 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0b00386e-49fd-4cc2-a37f-65f6ccc66af8 req-d5f23f03-11cf-4f0e-a3cb-2abdd236a88d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0544965 Nov 15 12:47:15.793200 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0b00386e-49fd-4cc2-a37f-65f6ccc66af8 req-cc194455-098e-4f29-bbe8-97dfe4a49cfe tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510435 Nov 15 12:47:16.928651 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d2700a-c9d2-4a12-90e8-42a2f2610e26 req-86a5b5ea-f8e5-41bd-92cd-eab3729bea8d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:16.930014 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b2d2700a-c9d2-4a12-90e8-42a2f2610e26 req-86a5b5ea-f8e5-41bd-92cd-eab3729bea8d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0520015 Nov 15 12:47:16.978183 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b2d2700a-c9d2-4a12-90e8-42a2f2610e26 req-db87b863-3e32-4069-bac0-374f7311efdc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419493 Nov 15 12:47:18.106807 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f2681d-5fb0-4e97-bb01-874a134a219f req-8e2088d4-0e83-412b-a41e-e27dabf966f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:18.109036 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61f2681d-5fb0-4e97-bb01-874a134a219f req-8e2088d4-0e83-412b-a41e-e27dabf966f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0503867 Nov 15 12:47:18.157536 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-61f2681d-5fb0-4e97-bb01-874a134a219f req-7f6b7179-f1e7-492c-90ff-cd42756fe703 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424135 Nov 15 12:47:19.281315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc8068e-84ed-48f4-8e3b-00965828a5f8 req-5e708f05-653b-4efb-9934-39b745fb8195 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:19.282877 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8dc8068e-84ed-48f4-8e3b-00965828a5f8 req-5e708f05-653b-4efb-9934-39b745fb8195 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0518596 Nov 15 12:47:19.332189 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8dc8068e-84ed-48f4-8e3b-00965828a5f8 req-60ae9f5d-b944-4c29-95b1-4524869148eb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433865 Nov 15 12:47:20.458601 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4875e10e-2f3c-4921-b954-8ab679bc7631 req-fee9f94c-2fd5-4740-ac10-9e0edab6dcc1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:20.460012 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4875e10e-2f3c-4921-b954-8ab679bc7631 req-fee9f94c-2fd5-4740-ac10-9e0edab6dcc1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0520866 Nov 15 12:47:20.509783 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4875e10e-2f3c-4921-b954-8ab679bc7631 req-34019138-aac8-4759-9fc0-462e93274371 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434568 Nov 15 12:47:21.630076 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1fbe50-1109-4c1f-b44b-012b094ad854 req-3d109b40-9986-4381-b8b3-ae6ca0193e05 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:21.631611 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5d1fbe50-1109-4c1f-b44b-012b094ad854 req-3d109b40-9986-4381-b8b3-ae6ca0193e05 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0487466 Nov 15 12:47:21.686193 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5d1fbe50-1109-4c1f-b44b-012b094ad854 req-aeceea9f-6a01-4d43-b8db-d2fec8d4d462 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457151 Nov 15 12:47:22.810201 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aadbe0e-d4e4-4478-8cbb-db9712ce3ac7 req-8ffea3cc-b56b-4763-ae7e-1cc29ec8b305 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:22.811653 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9aadbe0e-d4e4-4478-8cbb-db9712ce3ac7 req-8ffea3cc-b56b-4763-ae7e-1cc29ec8b305 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0536125 Nov 15 12:47:22.860979 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9aadbe0e-d4e4-4478-8cbb-db9712ce3ac7 req-04e4ae79-70f8-44b3-9aee-cf18bf7703a4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433517 Nov 15 12:47:23.894745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1259e9e3-009a-4732-a4ed-42be5a02b6d1 req-717cde04-3c5e-4a32-9420-a309f92fe858 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:23.896343 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1259e9e3-009a-4732-a4ed-42be5a02b6d1 req-717cde04-3c5e-4a32-9420-a309f92fe858 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0600100 Nov 15 12:47:23.949897 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1259e9e3-009a-4732-a4ed-42be5a02b6d1 req-5f573c32-214e-4008-bef5-489050367475 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473769 Nov 15 12:47:24.006161 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cae6166-4f1b-46d1-acbe-4fab37133ea5 req-e019d649-40b7-4719-a852-289e1a78101b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:24.007711 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0cae6166-4f1b-46d1-acbe-4fab37133ea5 req-e019d649-40b7-4719-a852-289e1a78101b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0613158 Nov 15 12:47:24.056839 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0cae6166-4f1b-46d1-acbe-4fab37133ea5 req-fa8651f9-9f1b-4895-8eb5-4ad13baa1e2c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432792 Nov 15 12:47:25.084387 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce39aa-1208-4b25-af02-3bb0e5650acf req-612745e2-095e-4492-8512-e8d690501594 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:25.086308 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-19ce39aa-1208-4b25-af02-3bb0e5650acf req-612745e2-095e-4492-8512-e8d690501594 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0579786 Nov 15 12:47:25.149194 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-19ce39aa-1208-4b25-af02-3bb0e5650acf req-5079f8c5-3f57-400a-a0d8-27399dea7d51 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521414 Nov 15 12:47:25.204737 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9f6039-7113-45ac-900d-1b13e48d8396 req-f3ac0452-75a8-41c9-a2f5-e40a61a53227 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:25.206285 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3a9f6039-7113-45ac-900d-1b13e48d8396 req-f3ac0452-75a8-41c9-a2f5-e40a61a53227 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0575914 Nov 15 12:47:25.265588 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3a9f6039-7113-45ac-900d-1b13e48d8396 req-2dae0754-a4f8-44cd-9c1a-0e7f5cd207ba tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0527031 Nov 15 12:47:26.066093 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-b499f344-e40f-4974-91f7-8fabc9cee71b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:26.067923 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-b499f344-e40f-4974-91f7-8fabc9cee71b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0651069 Nov 15 12:47:26.185713 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:47:26.186154 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:26.304934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b348487f-f3d8-460b-a5b0-ed0ce126a43f req-e406d894-1613-4ac3-ba2d-5fcdaee27f0f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:26.306573 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b348487f-f3d8-460b-a5b0-ed0ce126a43f req-e406d894-1613-4ac3-ba2d-5fcdaee27f0f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 945 time: 0.0587475 Nov 15 12:47:26.350302 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] For port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:26.351189 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:26.374352 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b348487f-f3d8-460b-a5b0-ed0ce126a43f req-72502923-dac3-4d02-bf79-5c2b397d627e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0593977 Nov 15 12:47:26.415165 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba90683-2671-4fa3-a1ae-37321222d0d3 req-7951213d-ef54-4302-b36c-621b84519f86 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:26.416865 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7ba90683-2671-4fa3-a1ae-37321222d0d3 req-7951213d-ef54-4302-b36c-621b84519f86 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1106339 Nov 15 12:47:26.518913 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba6bf7b-2100-4410-8c28-589a570fe64b req-f0b8b73c-3818-4bc7-b87c-65d23ed7524a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:26.520643 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eba6bf7b-2100-4410-8c28-589a570fe64b req-f0b8b73c-3818-4bc7-b87c-65d23ed7524a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0684013 Nov 15 12:47:26.527364 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7ba90683-2671-4fa3-a1ae-37321222d0d3 req-54056786-c12b-4643-9b6b-6a6d95599fc0 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1012936 Nov 15 12:47:26.573058 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eba6bf7b-2100-4410-8c28-589a570fe64b req-6a516f61-4ca5-4efc-96ae-46be7f922e9f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461447 Nov 15 12:47:26.592947 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:26.593307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:26.593616 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP 2ed2e1f6-c353-477a-a6df-fdfd10382523 disassociated. External IP: 172.27.0.107, port: d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8. Nov 15 12:47:26.593956 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:47:26.744043 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:26.774856 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:26.905468 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:47:27.023345 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:47:27.037168 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:47:27.051441 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:47:27.052402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:47:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:27.065996 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] No DVR routers for this DVR port d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:47:27.069006 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:27.072607 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-937588a6-b1dd-46e7-86b7-3f332055b4ec req-ec9a49c5-6963-4748-9c0e-c726462d0ebd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "DELETE /v2.0/ports/d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 HTTP/1.1" status: 204 len: 173 time: 0.9879754 Nov 15 12:47:27.073096 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'name': 'network-vif-deleted', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:27.075540 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1747dfd3-6f56-4b61-94aa-fed192a5c214" -d '{"events": [{"server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "name": "network-vif-deleted", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:27.117673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b0d8185-35b4-4e36-82a9-6c4eec359baf x-openstack-request-id: req-4b0d8185-35b4-4e36-82a9-6c4eec359baf {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:27.118054 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "49c75c58-0b7e-448b-8179-0af71aebd844", "name": "network-vif-deleted", "tag": "d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:27.118313 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-4b0d8185-35b4-4e36-82a9-6c4eec359baf {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:27.118855 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '49c75c58-0b7e-448b-8179-0af71aebd844', 'name': 'network-vif-deleted', 'tag': 'd6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8', 'status': 'completed', 'code': 200} Nov 15 12:47:27.230258 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:47:27.481316 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:27.486520 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b4ab5e95-8111-40e9-a640-8d7cb739f894 req-589f440b-dd29-4fa9-8712-e1361bda74f5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=49c75c58-0b7e-448b-8179-0af71aebd844 HTTP/1.1" status: 200 len: 210 time: 0.0283935 Nov 15 12:47:27.513033 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:47:27.523328 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:47:27.523989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:47:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:27.659557 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:47:27.711103 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63202545-c8b0-4144-8746-15e00bad3719 req-ccb0e4ea-8f7e-4484-9103-0646adc59183 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:27.715698 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63202545-c8b0-4144-8746-15e00bad3719 req-ccb0e4ea-8f7e-4484-9103-0646adc59183 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0877390 Nov 15 12:47:27.764589 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1604248e-a183-449d-96ad-ebb644621109 req-8441c88e-874d-4003-b829-27c544b12cf8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:27.767082 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1604248e-a183-449d-96ad-ebb644621109 req-8441c88e-874d-4003-b829-27c544b12cf8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0769653 Nov 15 12:47:27.796664 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-63202545-c8b0-4144-8746-15e00bad3719 req-46a65b4d-39e6-4b79-b1e0-8357523bdf37 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0747488 Nov 15 12:47:27.840353 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1604248e-a183-449d-96ad-ebb644621109 req-2264336e-5c74-48de-bce2-07436420a6ad tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669763 Nov 15 12:47:27.935854 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:27.970254 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3a62acb-4958-4f89-8ea4-6c055de96f8b None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:47:28.216558 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0956891-a228-42d1-a977-3c5ba4afc07d None None] New status for floating IP 2ed2e1f6-c353-477a-a6df-fdfd10382523: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:47:28.765421 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-abae6636-73f4-4991-b73a-cabd796796cd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-690150005&fields=id&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 267 time: 0.0463648 Nov 15 12:47:28.877129 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-5460b325-262f-44f5-89eb-48eeaecdbb57 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:28.878754 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-5460b325-262f-44f5-89eb-48eeaecdbb57 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.1060700 Nov 15 12:47:28.894698 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-c69dee51-c468-401c-bd93-4c793ce5e8e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/quotas/ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 375 time: 0.0099363 Nov 15 12:47:28.936602 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f76e47-8d1c-43e5-8e75-cb97b5b90a98 req-3ce6763a-f4e0-4ecd-9189-67f06f6e074d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:28.939011 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-59f76e47-8d1c-43e5-8e75-cb97b5b90a98 req-3ce6763a-f4e0-4ecd-9189-67f06f6e074d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0564878 Nov 15 12:47:28.952029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-c1bec484-44eb-42ac-9ae6-329379d8cd25 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0515392 Nov 15 12:47:29.014089 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-59f76e47-8d1c-43e5-8e75-cb97b5b90a98 req-9459759c-28c7-456c-9c9a-cba7326ae6dd tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0696902 Nov 15 12:47:29.078325 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-dc361a36-f1b9-4eee-90d3-00eeb4a7d247 service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1115422 Nov 15 12:47:29.168375 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9fe6e8-6248-4415-8b64-edb83a4f1bd9 req-40b954ab-0003-48fe-94aa-2c612782fbe4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:29.178389 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cb9fe6e8-6248-4415-8b64-edb83a4f1bd9 req-40b954ab-0003-48fe-94aa-2c612782fbe4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0778935 Nov 15 12:47:29.195228 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-44ba2e60-a3e4-469f-967b-2d4266cf4f45 service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1080160 Nov 15 12:47:29.261246 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cb9fe6e8-6248-4415-8b64-edb83a4f1bd9 req-6f5039fa-8b28-4ab3-871f-42b8be8f953c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0811479 Nov 15 12:47:29.527546 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:47:29.570371 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:47:29.615657 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:47:29.621700 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device d6001c8f-22d5-4ff7-9cae-5eb9d42ea2f8 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:47:29.675793 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c4b361fa-fe0c-4ea0-a84f-c2a885093a10 req-9e533d4d-c0a0-4de6-babb-a942e972c06f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 210 time: 0.0542233 Nov 15 12:47:29.782883 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:29.802348 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'f03748f1-6421-4492-82d3-c659e117188c', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:47:29.844953 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:29.869495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id f03748f1-6421-4492-82d3-c659e117188c {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:47:29.895358 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:29.901374 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:29.985260 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=6']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:29.994125 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.994125 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.994917 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.994917 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.995447 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.995768 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.995950 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.996594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.996594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.997087 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.997330 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:29.997645 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:30.122255 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['f03748f1-6421-4492-82d3-c659e117188c'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:47:30.261822 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb81d2d-e8f0-4a58-ad88-912c89930dd2 req-4f984139-0955-460a-b2c7-17c268888bb3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:30.273029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9fb81d2d-e8f0-4a58-ad88-912c89930dd2 req-4f984139-0955-460a-b2c7-17c268888bb3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1270382 Nov 15 12:47:30.390728 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9fb81d2d-e8f0-4a58-ad88-912c89930dd2 req-6476bf11-7a3a-479f-90b6-0782e31d139c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1159332 Nov 15 12:47:30.457846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c889c3-1302-4366-b9f5-6f41c044ad15 req-67785e4c-b4a2-4291-83e9-cc2cc5dafa48 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:30.460607 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b8c889c3-1302-4366-b9f5-6f41c044ad15 req-67785e4c-b4a2-4291-83e9-cc2cc5dafa48 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 944 time: 0.0679891 Nov 15 12:47:30.540824 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b8c889c3-1302-4366-b9f5-6f41c044ad15 req-ea05a6a3-db12-48b1-ad73-2ed4e2c7f2c0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720468 Nov 15 12:47:30.804962 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3b3a94a0-b806-498f-aefd-1df37d6f036f req-ab029a83-6cf9-4d37-bad1-7cb37f7aa838 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 210 time: 0.0294757 Nov 15 12:47:31.279403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-eea1cd32-b93f-42a6-8afd-c0d528b95d6b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:31.281127 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-eea1cd32-b93f-42a6-8afd-c0d528b95d6b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.1730146 Nov 15 12:47:31.402427 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-bb842a5a-b28f-4b14-ba17-bb9f8409b419 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 379 time: 0.0828919 Nov 15 12:47:31.417258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'port': {'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'admin_state_up': True, 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'security_groups': ['f5f8a6e7-eff7-4cff-a4f3-64559906341e']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:47:31.539402 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:47:31.593221 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9482e548-69a5-4702-bb30-166d5bf99dab req-8b98a363-d8a2-423a-98be-823f423a1e73 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:31.595650 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9482e548-69a5-4702-bb30-166d5bf99dab req-8b98a363-d8a2-423a-98be-823f423a1e73 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0901752 Nov 15 12:47:31.625021 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Made reservation on behalf of ad165f3ffe59498e88611526ef4c254d for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:47:31.629003 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:31.641059 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port f03748f1-6421-4492-82d3-c659e117188c triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:47:31.649949 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:31.753705 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9482e548-69a5-4702-bb30-166d5bf99dab req-feb6c272-816c-4a9a-97d9-0078fda3c09c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1451290 Nov 15 12:47:31.800912 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:31.802794 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb7cc79-331f-467f-ad83-a5f60637b76d req-336d71d5-7d39-4784-8329-34f517774b45 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:31.807061 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bbb7cc79-331f-467f-ad83-a5f60637b76d req-336d71d5-7d39-4784-8329-34f517774b45 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 944 time: 0.1111901 Nov 15 12:47:31.843310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:31.845707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08db2206-609f-4c49-87d2-255de7d993dd" -d '{"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:31.861464 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:31.869477 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:31.927856 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=7']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:31.957403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.20.0.6 (7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f/2a6efff2-9e7d-4592-b2fe-44911cde042e/7dc03216-eb2b-4d3e-8246-eb7309dc3e9a) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:47:31.979997 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bbb7cc79-331f-467f-ad83-a5f60637b76d req-a7a4c174-6b4b-42ee-9b0d-3c81ae181791 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1614542 Nov 15 12:47:32.028595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-41267eaa-b13b-47bf-995a-0cc4ca86a36a req-35aaabbb-697e-431d-8a65-8244318f514c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 210 time: 0.0478768 Nov 15 12:47:32.114379 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55ff970e-ddf3-4d8f-8d5d-99ff8bd3d2f4 x-openstack-request-id: req-55ff970e-ddf3-4d8f-8d5d-99ff8bd3d2f4 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:32.114673 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:32.114919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-55ff970e-ddf3-4d8f-8d5d-99ff8bd3d2f4 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:32.115334 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'code': 200} Nov 15 12:47:32.236185 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.279230 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.345952 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:47:32.349279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:47:32.353887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:47:32.379244 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:32.416780 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:32.417475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.465303 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-89fc73d0-5e96-4402-a339-c14b12a69265 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0525048 Nov 15 12:47:32.486597 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Request body: {'port': {'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:47:32.559982 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.674775 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-6290b8b6-4454-47aa-b41c-2a8399ac0d30 None None] Provisioning complete for port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:47:32.675325 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-6290b8b6-4454-47aa-b41c-2a8399ac0d30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.720308 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-6290b8b6-4454-47aa-b41c-2a8399ac0d30 None None] Port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:47:32.964689 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:47:32.976439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:32.998357 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46daed3a-181d-45c6-9c1b-40fc12f6161f req-a4e87225-4c32-4319-82f7-be5609409e39 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:32.999955 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46daed3a-181d-45c6-9c1b-40fc12f6161f req-a4e87225-4c32-4319-82f7-be5609409e39 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1102774 Nov 15 12:47:33.002961 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Transition to ACTIVE for port object 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:47:33.007349 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:33.211869 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b08c23e8-fee8-4cf7-b79d-97427573cdc3 req-4a8f5746-9326-43d6-a1cf-dce916dbf813 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:33.219744 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b08c23e8-fee8-4cf7-b79d-97427573cdc3 req-4a8f5746-9326-43d6-a1cf-dce916dbf813 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0760708 Nov 15 12:47:33.297282 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b08c23e8-fee8-4cf7-b79d-97427573cdc3 req-fbf48e78-2d4c-484b-a7d0-9ee74678700d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697713 Nov 15 12:47:33.364943 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-da8906cb-bfed-4935-8e0f-67d22fda1c2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:33.415225 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaedc69-050b-47a8-98a8-798e838a77e9 req-d5048e2a-bf0b-4d64-b636-b7711ea70e37 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:33.423265 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8eaedc69-050b-47a8-98a8-798e838a77e9 req-d5048e2a-bf0b-4d64-b636-b7711ea70e37 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0625942 Nov 15 12:47:33.485338 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-8eaedc69-050b-47a8-98a8-798e838a77e9 req-a42bee0a-baa1-4b10-b862-59df1eaedcf8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0604935 Nov 15 12:47:33.491005 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Pushing event updated for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:33.520555 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-46daed3a-181d-45c6-9c1b-40fc12f6161f req-1ba37031-84e1-4d7b-9f59-2767caee2796 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5098896 Nov 15 12:47:33.584156 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Attempting to bind port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:47:33.584876 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Attempting to bind port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:47:33.585469 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Attempting to bind port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:47:33.590772 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:47:33.591124 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Attempting to bind port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:47:33.596816 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 47, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:47:33.597150 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:47:33.597531 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Bound using segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:47:33.597958 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Bound port: 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:47:33.598317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:33.673859 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:47:33.680073 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:47:33.686329 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:33.733974 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:33.735230 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:33.737130 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] 10.222.0.61 "PUT /v2.0/ports/7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 1093 time: 1.2552049 Nov 15 12:47:33.739790 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:33.742938 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-facb68c5-7995-42ae-8908-167cd49f1493" -d '{"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:33.787185 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744b6f98-de38-4d44-b93b-ac2abaa3eec1 service neutron] Pushing event updated for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:33.825855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34734641-30b0-4eba-a458-e23b3d8fbec1 x-openstack-request-id: req-34734641-30b0-4eba-a458-e23b3d8fbec1 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:33.826242 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:33.826508 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-34734641-30b0-4eba-a458-e23b3d8fbec1 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:33.826953 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'status': 'completed', 'code': 200} Nov 15 12:47:33.900753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-9666ed9c-6df7-455d-a69e-09db15cf43eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:33.902739 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-9666ed9c-6df7-455d-a69e-09db15cf43eb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1096 time: 0.0581472 Nov 15 12:47:33.966252 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-4dca0ec2-6aad-4510-8bea-b9d641f687c9 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 217 time: 0.0451262 Nov 15 12:47:34.030572 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-709b613e-ff29-47ae-9efd-95d1f3be3f30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.032073 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-709b613e-ff29-47ae-9efd-95d1f3be3f30 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0560961 Nov 15 12:47:34.113060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-415e1b4b-7472-466a-80d1-d19645765206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.114873 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-415e1b4b-7472-466a-80d1-d19645765206 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0671167 Nov 15 12:47:34.246989 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-5a5276b7-c98f-46ef-a2a0-b0699ac459dc service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213899 Nov 15 12:47:34.384704 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-28e038cd-0a42-4eac-a70a-a307a8986821 req-f581ed92-b859-43d9-9508-6fa9f91f900d service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239483 Nov 15 12:47:34.441654 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1550c904-7c33-4adb-ba33-102f33aa6d45 req-4dacd42a-c4b9-4d3e-ac54-6d78575f9f7d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.446077 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1550c904-7c33-4adb-ba33-102f33aa6d45 req-4dacd42a-c4b9-4d3e-ac54-6d78575f9f7d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0700641 Nov 15 12:47:34.574809 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1550c904-7c33-4adb-ba33-102f33aa6d45 req-bf10d53c-dccf-4233-a2e7-30b039d65f97 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1247141 Nov 15 12:47:34.611642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb68c5-7995-42ae-8908-167cd49f1493 req-35de7916-6124-4eb8-9112-ca002aad524b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.613759 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-35de7916-6124-4eb8-9112-ca002aad524b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1096 time: 0.0912571 Nov 15 12:47:34.663555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d69ef82-13c7-44b2-9a44-5944f8708cb9 req-fc6e05b5-cb27-48df-87cd-a49b0b1432c1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.672731 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d69ef82-13c7-44b2-9a44-5944f8708cb9 req-fc6e05b5-cb27-48df-87cd-a49b0b1432c1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0696492 Nov 15 12:47:34.736773 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4d69ef82-13c7-44b2-9a44-5944f8708cb9 req-429e1e56-fbcc-4f5f-acea-84c1f2ea1438 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592349 Nov 15 12:47:34.808102 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-904413f2-aadf-4f4f-b9ec-f2ce2bb62566 req-03fed575-6dd6-4081-b118-bb60bf75442d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.808594 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-904413f2-aadf-4f4f-b9ec-f2ce2bb62566 req-03fed575-6dd6-4081-b118-bb60bf75442d tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.1267610 Nov 15 12:47:34.837562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb68c5-7995-42ae-8908-167cd49f1493 req-906eec0e-48e6-4f10-9332-ed4267cdd641 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.839755 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-906eec0e-48e6-4f10-9332-ed4267cdd641 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.2084744 Nov 15 12:47:34.918147 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-ebfc90aa-5ca2-41f6-b4e5-edb75d5f2e16 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 217 time: 0.0514090 Nov 15 12:47:34.925656 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-904413f2-aadf-4f4f-b9ec-f2ce2bb62566 req-2b6bfa00-a47a-40b7-b6c3-12404821f692 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1104419 Nov 15 12:47:34.988707 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb68c5-7995-42ae-8908-167cd49f1493 req-f53887fa-015b-4b28-9b23-4bd351ba81f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:34.990183 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-f53887fa-015b-4b28-9b23-4bd351ba81f8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0633242 Nov 15 12:47:35.050078 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb68c5-7995-42ae-8908-167cd49f1493 req-02c5c733-3ccc-4fdf-b0e2-ee2fda17cdc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:35.051635 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-02c5c733-3ccc-4fdf-b0e2-ee2fda17cdc5 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0529807 Nov 15 12:47:35.175679 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-bee1c03c-8155-46fc-9e19-209524c1ab24 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1064794 Nov 15 12:47:35.300896 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-facb68c5-7995-42ae-8908-167cd49f1493 req-dfd82c76-5bd5-42a7-ae37-bd1b886b98ee service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1134450 Nov 15 12:47:35.720097 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5072373-c0ec-40e4-8fe0-294d11f4bf5e req-b6143fc5-68be-4ab8-97f5-08121395deea tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:35.721750 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b5072373-c0ec-40e4-8fe0-294d11f4bf5e req-b6143fc5-68be-4ab8-97f5-08121395deea tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0607617 Nov 15 12:47:35.807717 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b5072373-c0ec-40e4-8fe0-294d11f4bf5e req-10fa9733-b79c-48be-8183-81f33c03eb3b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0787380 Nov 15 12:47:35.808370 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-54d2246d-eee8-48eb-aa4a-772315d1773a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:35.935000 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9dc5be-3bb3-474d-8e38-8c39d97d9e08 req-0fa75573-2929-423a-b392-b38dc248108c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:35.937066 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5a9dc5be-3bb3-474d-8e38-8c39d97d9e08 req-0fa75573-2929-423a-b392-b38dc248108c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0611403 Nov 15 12:47:36.037653 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5a9dc5be-3bb3-474d-8e38-8c39d97d9e08 req-5c2b7829-0170-4082-bf3c-6816290e39dd tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0922225 Nov 15 12:47:36.116958 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2f4016-d8b0-4399-a4f9-c295e886c7b4 req-b0ff6563-9c05-48c7-8e15-53348fec63bf tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:36.126202 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ee2f4016-d8b0-4399-a4f9-c295e886c7b4 req-b0ff6563-9c05-48c7-8e15-53348fec63bf tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0897882 Nov 15 12:47:36.181878 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ee2f4016-d8b0-4399-a4f9-c295e886c7b4 req-b3cfaecc-256b-4148-8d99-b58bf49cc410 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0547132 Nov 15 12:47:36.880430 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:36.945365 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbef89fa-6ed3-4fdb-8ed6-c02301571e29 req-5c13eeb6-4f9d-4381-a7e1-1404da1c4984 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:36.946828 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fbef89fa-6ed3-4fdb-8ed6-c02301571e29 req-5c13eeb6-4f9d-4381-a7e1-1404da1c4984 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0597422 Nov 15 12:47:37.000665 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fbef89fa-6ed3-4fdb-8ed6-c02301571e29 req-39555987-3007-4451-8088-7b9c965239af tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460405 Nov 15 12:47:37.194122 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b890a6ac-6213-4b0e-bb2d-066f66536cd1 req-3a5c5040-6046-44a8-b523-848de1e12770 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:37.196383 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b890a6ac-6213-4b0e-bb2d-066f66536cd1 req-3a5c5040-6046-44a8-b523-848de1e12770 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0597250 Nov 15 12:47:37.271601 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b890a6ac-6213-4b0e-bb2d-066f66536cd1 req-0eccadec-16a9-441c-8e47-78e5b18019b6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0641031 Nov 15 12:47:37.336691 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a13abc0-f814-4740-b9c0-527eb58beba7 req-8b63b236-3ee5-497f-8764-b701d781ec3f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:37.338300 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2a13abc0-f814-4740-b9c0-527eb58beba7 req-8b63b236-3ee5-497f-8764-b701d781ec3f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0812516 Nov 15 12:47:37.394015 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2a13abc0-f814-4740-b9c0-527eb58beba7 req-8671efc2-34d1-4b0c-bac0-3d74978b3258 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488079 Nov 15 12:47:37.651903 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae919e4-e1a9-48ee-a537-7f60aa84923e req-13fe0041-3b11-4a11-9751-c1f9ce1d9755 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:37.654090 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6ae919e4-e1a9-48ee-a537-7f60aa84923e req-13fe0041-3b11-4a11-9751-c1f9ce1d9755 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0641611 Nov 15 12:47:37.750169 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-dd9cd16c-2fdb-4ebf-bafa-d4f17494ce21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:37.751832 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-dd9cd16c-2fdb-4ebf-bafa-d4f17494ce21 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1099 time: 0.0780959 Nov 15 12:47:37.756613 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6ae919e4-e1a9-48ee-a537-7f60aa84923e req-eb9c40eb-473d-4b3e-9793-10d99a1a637b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0955491 Nov 15 12:47:37.872560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-3b37d27f-e6c3-4a54-8ac5-0e8a3498f28b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:37.874161 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-3b37d27f-e6c3-4a54-8ac5-0e8a3498f28b service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1144311 Nov 15 12:47:37.957246 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-65281e88-aee3-4a1a-ab07-e991b15850cd service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 1001 time: 0.0733695 Nov 15 12:47:38.023311 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-f42591ca-c0f1-4410-a4f9-468c0023c73a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:38.025022 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-f42591ca-c0f1-4410-a4f9-468c0023c73a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0604792 Nov 15 12:47:38.086412 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-2f38da09-8ba3-4880-a426-817f1e5f4339 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:38.087936 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-2f38da09-8ba3-4880-a426-817f1e5f4339 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0555191 Nov 15 12:47:38.174417 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7d07da-09ae-4551-aa1b-dd6fb51df2e3 req-bd842272-bbe6-4d14-8d90-9dfa0c1c7a93 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:38.175856 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bc7d07da-09ae-4551-aa1b-dd6fb51df2e3 req-bd842272-bbe6-4d14-8d90-9dfa0c1c7a93 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0803995 Nov 15 12:47:38.225573 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-6b3857ea-0bc0-4b96-a15f-b1a111d52334 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1202288 Nov 15 12:47:38.250251 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bc7d07da-09ae-4551-aa1b-dd6fb51df2e3 req-5e72c60f-fe90-4bac-a5be-87c3994d6645 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640478 Nov 15 12:47:38.351249 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:38.386622 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1d1875d0-cd14-400c-8d94-1179e81d7d96 req-b412540c-9602-4b43-8928-3c215e12c224 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1451263 Nov 15 12:47:38.439746 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d3182a-ee11-4a26-8bf5-4533fbe96671 req-1a9463b3-7c88-4422-8726-41a897ed7279 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:38.447305 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-17d3182a-ee11-4a26-8bf5-4533fbe96671 req-1a9463b3-7c88-4422-8726-41a897ed7279 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0900698 Nov 15 12:47:38.527419 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-17d3182a-ee11-4a26-8bf5-4533fbe96671 req-087855f9-07db-4c93-93d7-9ff064fe7c98 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0791399 Nov 15 12:47:38.885806 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f296a79d-f707-40fe-9b7c-825b723d1411 req-ac542d89-477c-499a-95b6-b4e6cd45fad3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:38.886873 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f296a79d-f707-40fe-9b7c-825b723d1411 req-ac542d89-477c-499a-95b6-b4e6cd45fad3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0561249 Nov 15 12:47:38.954593 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f296a79d-f707-40fe-9b7c-825b723d1411 req-2d6ce2bd-6357-4547-bb48-4d623c0509be tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0597229 Nov 15 12:47:39.142538 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:39.417297 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dee1ac1-472c-4d56-b106-cd493caeffe3 req-9c93afda-8ec6-4d7a-a788-a9b2d866a2b2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:39.418888 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2dee1ac1-472c-4d56-b106-cd493caeffe3 req-9c93afda-8ec6-4d7a-a788-a9b2d866a2b2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0679474 Nov 15 12:47:39.470372 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2dee1ac1-472c-4d56-b106-cd493caeffe3 req-3270f653-07dd-4aa7-933c-181c3bbd69d1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441730 Nov 15 12:47:39.658182 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8ac268-3b11-442f-a550-af03475a93d5 req-91db1ed9-200e-41a1-b1be-32bf5a786ee2 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:39.659805 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab8ac268-3b11-442f-a550-af03475a93d5 req-91db1ed9-200e-41a1-b1be-32bf5a786ee2 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0539219 Nov 15 12:47:39.716295 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ab8ac268-3b11-442f-a550-af03475a93d5 req-4650340b-ac38-44d2-ac71-1af79567133f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500615 Nov 15 12:47:40.091370 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f678022-e02b-4dc7-93a5-0df1ddc31d3f req-bafac196-0cd8-4bb9-acf6-7d718281d7ab tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.092802 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f678022-e02b-4dc7-93a5-0df1ddc31d3f req-bafac196-0cd8-4bb9-acf6-7d718281d7ab tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0670016 Nov 15 12:47:40.139816 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-5f678022-e02b-4dc7-93a5-0df1ddc31d3f req-fae4e13e-224c-4086-8b72-bd96c248d1a3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410616 Nov 15 12:47:40.534112 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-2b2ad7df-0725-4d0a-8b42-5a2770a6f56d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.535587 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-2b2ad7df-0725-4d0a-8b42-5a2770a6f56d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1098 time: 0.0468609 Nov 15 12:47:40.604061 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af000caa-6d48-4988-834d-64bb059612b2 req-42a74dd6-d774-446b-8abf-7f53d0f425cd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.605630 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af000caa-6d48-4988-834d-64bb059612b2 req-42a74dd6-d774-446b-8abf-7f53d0f425cd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0578535 Nov 15 12:47:40.638957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-c506bc3f-6c36-41eb-8287-a056451cd64a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.640997 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-c506bc3f-6c36-41eb-8287-a056451cd64a service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.0971730 Nov 15 12:47:40.662477 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-af000caa-6d48-4988-834d-64bb059612b2 req-77639dc5-a36b-4abc-a9a4-dc1793565582 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500834 Nov 15 12:47:40.724740 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-6ca3328c-781c-4d20-b7cf-5079d1a4fb63 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 1000 time: 0.0685549 Nov 15 12:47:40.763766 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:47:40.798466 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-554bf4b5-d0a5-42a8-9ef4-06f70cb8777d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.799930 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-554bf4b5-d0a5-42a8-9ef4-06f70cb8777d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.0675747 Nov 15 12:47:40.866724 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b8e078-e806-4242-8137-03a927fae96e req-7a947a91-de60-4762-8843-6cdb16063fce tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.868202 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f9b8e078-e806-4242-8137-03a927fae96e req-7a947a91-de60-4762-8843-6cdb16063fce tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0822201 Nov 15 12:47:40.874306 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-d63f7ee3-6db7-4810-b3ec-cc7d69377811 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:40.876356 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-d63f7ee3-6db7-4810-b3ec-cc7d69377811 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0580878 Nov 15 12:47:40.970464 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f9b8e078-e806-4242-8137-03a927fae96e req-bad8de2b-2975-43ef-ae0a-38c5424a27a5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0931664 Nov 15 12:47:40.994904 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-848ace8e-08bb-4e87-8857-9ea8433b8001 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1109815 Nov 15 12:47:41.086307 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7bb1e3b7-506f-43c9-832a-36a36cbfc015 req-fd650760-5727-4b81-8b7a-fda028f851c5 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834408 Nov 15 12:47:41.791440 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae24fd39-7501-4066-ad6f-53da1ce40939 req-6c2fb07c-2845-40ae-bf8d-6aa027faa9b5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:41.792974 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ae24fd39-7501-4066-ad6f-53da1ce40939 req-6c2fb07c-2845-40ae-bf8d-6aa027faa9b5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0541177 Nov 15 12:47:41.840971 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ae24fd39-7501-4066-ad6f-53da1ce40939 req-eab9f19b-8385-4715-a994-2cf1c3d42b51 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420544 Nov 15 12:47:42.088280 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b15fb9-dcf3-4e06-a250-f85ec15c181e req-ac4ccf53-0778-44e0-a06c-dbe0c7809e5b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:42.089817 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37b15fb9-dcf3-4e06-a250-f85ec15c181e req-ac4ccf53-0778-44e0-a06c-dbe0c7809e5b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0514810 Nov 15 12:47:42.141497 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37b15fb9-dcf3-4e06-a250-f85ec15c181e req-97fc8ab0-cd90-49f9-a227-d884b77d1b24 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451918 Nov 15 12:47:42.970593 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58669ab6-1a58-474b-92ce-669774f7bc6a req-b1dcdbdd-0b10-4366-942f-065de86b8301 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:42.972158 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-58669ab6-1a58-474b-92ce-669774f7bc6a req-b1dcdbdd-0b10-4366-942f-065de86b8301 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 945 time: 0.0515769 Nov 15 12:47:43.019771 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-58669ab6-1a58-474b-92ce-669774f7bc6a req-7872efe6-18dc-4c72-82d5-8c28a065701e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415673 Nov 15 12:47:43.260800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8956da-66a6-4d06-ac78-34069b8c51d4 req-8b899f68-89a6-4d77-9105-b7f0db2bd655 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:43.263564 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2c8956da-66a6-4d06-ac78-34069b8c51d4 req-8b899f68-89a6-4d77-9105-b7f0db2bd655 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 943 time: 0.0519495 Nov 15 12:47:43.320418 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2c8956da-66a6-4d06-ac78-34069b8c51d4 req-cd0d73f2-b18f-40c9-b495-7d4e2ad9eec1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523593 Nov 15 12:47:43.606482 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:47:43.617651 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:47:43.761069 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:43.776029 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:43.778036 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 636, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:47:43.821478 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:43.823750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af046860-30ba-441d-b270-18bdcd497dd4" -d '{"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-unplugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:43.842621 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:43.849324 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:43.853412 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:44.004264 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3cad607-ba49-49ef-b68d-acbb1ec226fc x-openstack-request-id: req-a3cad607-ba49-49ef-b68d-acbb1ec226fc {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:44.004545 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-unplugged", "status": "failed", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "code": 422}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:44.004787 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-a3cad607-ba49-49ef-b68d-acbb1ec226fc {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:44.005179 dv-cinder-803823-7-iscsi neutron-server[108288]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'code': 422} returned with failed status Nov 15 12:47:44.013767 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:47:44.048156 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:44.049596 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=8']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:44.053587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:44.113584 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:44.121094 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:44.163655 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f6fc9e-63d5-4fe4-826b-d9f91bd9ae16 req-04d5d6d7-6b71-4d3a-a6bf-49286405aa44 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:44.163655 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-43f6fc9e-63d5-4fe4-826b-d9f91bd9ae16 req-04d5d6d7-6b71-4d3a-a6bf-49286405aa44 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0575862 Nov 15 12:47:44.213637 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-43f6fc9e-63d5-4fe4-826b-d9f91bd9ae16 req-a9f64f92-1be4-4467-8727-1b73265913fc tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439038 Nov 15 12:47:44.432231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:47:44.454429 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a15dd97f-a385-427c-b5f4-42801f92dc20 req-8efdd73a-4b9a-4f3f-a870-5448bc3234d4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:44.461633 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a15dd97f-a385-427c-b5f4-42801f92dc20 req-8efdd73a-4b9a-4f3f-a870-5448bc3234d4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 944 time: 0.0658424 Nov 15 12:47:44.512473 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a15dd97f-a385-427c-b5f4-42801f92dc20 req-f0fc9ce0-8a34-44e6-90b7-3241462588d6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491655 Nov 15 12:47:45.058380 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-34ff7d61-9aee-4749-9543-ef3ab7febae4 req-cbeaf6af-a553-4860-a617-e1598fdce5b3 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:47:45.059384 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-34ff7d61-9aee-4749-9543-ef3ab7febae4 req-cbeaf6af-a553-4860-a617-e1598fdce5b3 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053887 Nov 15 12:47:45.227053 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60c07b3-7a49-47df-b7f8-b8b4763e4683 req-63bddf84-17ba-43b5-ac08-c12a93389c68 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:45.228530 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b60c07b3-7a49-47df-b7f8-b8b4763e4683 req-63bddf84-17ba-43b5-ac08-c12a93389c68 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0562027 Nov 15 12:47:45.287992 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b60c07b3-7a49-47df-b7f8-b8b4763e4683 req-3688ebc1-c1e2-4e41-9d37-38324ba57e69 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536442 Nov 15 12:47:45.517927 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56368) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:47:45.613834 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:47:45.636079 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-4f5e30c0-76bb-426b-b9e9-40d1fc1a4b18 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1165862 Nov 15 12:47:45.649261 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514878d5-b9bf-43b8-8a43-5a773d0bdc1c req-66213296-d5c5-44e1-a8f3-318b4809c821 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:45.650724 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-514878d5-b9bf-43b8-8a43-5a773d0bdc1c req-66213296-d5c5-44e1-a8f3-318b4809c821 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 944 time: 0.0617528 Nov 15 12:47:45.654275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-36b3c83b-9f1e-4676-af0a-b82775161095 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:47:45.655218 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-36b3c83b-9f1e-4676-af0a-b82775161095 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0135651 Nov 15 12:47:45.665826 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:47:45.669788 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:47:45.670157 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:45.705407 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-514878d5-b9bf-43b8-8a43-5a773d0bdc1c req-7720546c-5512-491c-995b-1dd05638fec0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467498 Nov 15 12:47:45.748169 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:45.781735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:47:45.785546 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:45.786495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:47:45.870168 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:46.005946 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:46.009054 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a16cf75-e463-45ff-9b41-6c834a041661" -d '{"events": [{"server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "name": "network-vif-plugged", "status": "completed", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:46.046355 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad3c02cd-e25a-4b44-9818-f6db88fffa57 x-openstack-request-id: req-ad3c02cd-e25a-4b44-9818-f6db88fffa57 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:46.046646 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "name": "network-vif-plugged", "status": "completed", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:46.046896 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-ad3c02cd-e25a-4b44-9818-f6db88fffa57 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:46.047294 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'code': 200} Nov 15 12:47:46.426613 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb4f8ce-1b52-42fd-883f-279a23242902 req-8ef1f460-c34e-4928-9249-1568154022d9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:46.428211 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9bb4f8ce-1b52-42fd-883f-279a23242902 req-8ef1f460-c34e-4928-9249-1568154022d9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0607522 Nov 15 12:47:46.460089 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394a1243-5623-4a2a-9e30-03a86b966da6 req-a1d1c1b7-3ccf-4115-b39e-a7e0475d2e99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:46.461595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-394a1243-5623-4a2a-9e30-03a86b966da6 req-a1d1c1b7-3ccf-4115-b39e-a7e0475d2e99 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1098 time: 0.0758660 Nov 15 12:47:46.465278 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-ad5701ed-680f-4123-aed3-f640420f2d6f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0922680 Nov 15 12:47:46.480420 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9bb4f8ce-1b52-42fd-883f-279a23242902 req-037b530b-56ad-421d-ad06-aead5ee40d4e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457070 Nov 15 12:47:46.562283 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-394a1243-5623-4a2a-9e30-03a86b966da6 req-037364e4-38d3-4ea5-903a-ae83b7117d66 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619957 Nov 15 12:47:46.592010 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-e0e84c8c-ed28-4b3c-acee-0acc6d8a83f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:46.594022 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-e0e84c8c-ed28-4b3c-acee-0acc6d8a83f4 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 1099 time: 0.0511608 Nov 15 12:47:46.829226 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3640b1bb-dbdd-4e3c-96bf-f6b86a84111a req-628a63ad-e411-403d-8147-a6cd32d5a5cc tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:46.830773 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3640b1bb-dbdd-4e3c-96bf-f6b86a84111a req-628a63ad-e411-403d-8147-a6cd32d5a5cc tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0504162 Nov 15 12:47:46.939657 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3640b1bb-dbdd-4e3c-96bf-f6b86a84111a req-57c66d94-07c1-4422-86e8-a5003c1722d1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1008117 Nov 15 12:47:47.001749 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-c6c3757a-14fa-427c-8732-54cbd790741b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.003491 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-c6c3757a-14fa-427c-8732-54cbd790741b service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1466312 Nov 15 12:47:47.098283 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-4cada56c-a88a-4602-b09b-57359169db7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.099800 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-4cada56c-a88a-4602-b09b-57359169db7a service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67&tenant_id=5e23e880e5674cdb85e83c616f14f549 HTTP/1.1" status: 200 len: 1096 time: 0.1302009 Nov 15 12:47:47.101634 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-17e0d433-985e-47dc-bf3a-9f61107b1328 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 200 len: 1001 time: 0.0831184 Nov 15 12:47:47.195562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-229da956-1ec6-4208-826b-3a0c3c336ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.196985 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-229da956-1ec6-4208-826b-3a0c3c336ba4 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0709734 Nov 15 12:47:47.218178 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-d876409d-eb59-4b85-bae6-a25fdc6774f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.220198 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-d876409d-eb59-4b85-bae6-a25fdc6774f0 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=5e23e880e5674cdb85e83c616f14f549&device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1096 time: 0.0675712 Nov 15 12:47:47.315584 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-0e0b51fc-0a3e-40d8-98ab-c4475d96fad1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.317140 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-0e0b51fc-0a3e-40d8-98ab-c4475d96fad1 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1012366 Nov 15 12:47:47.385781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-3d01eef1-1654-4db9-9a61-820e3583b7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.387239 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-3d01eef1-1654-4db9-9a61-820e3583b7aa service neutron] 10.222.0.61 "GET /v2.0/networks?id=7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 200 len: 918 time: 0.1597266 Nov 15 12:47:47.476125 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-59420053-b267-492f-a17d-f52f2b352de6 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1499710 Nov 15 12:47:47.480037 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-edcae515-ca3d-49b1-ad69-2e19908a3870 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 200 len: 998 time: 0.0808978 Nov 15 12:47:47.631879 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48a6247-b0f0-4c82-8eff-2c436b619f59 req-5d821f0e-dcca-49af-88d6-f591b72ce1e0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.633478 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b48a6247-b0f0-4c82-8eff-2c436b619f59 req-5d821f0e-dcca-49af-88d6-f591b72ce1e0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0660195 Nov 15 12:47:47.684389 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-2afc4ac7-3df9-4066-965f-8b0c4916fbcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.685859 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-2afc4ac7-3df9-4066-965f-8b0c4916fbcc service neutron] 10.222.0.61 "GET /v2.0/subnets?id=45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 200 len: 856 time: 0.1136255 Nov 15 12:47:47.693783 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b48a6247-b0f0-4c82-8eff-2c436b619f59 req-1f0167f6-b5da-4d48-b245-968b03ea8529 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538831 Nov 15 12:47:47.738480 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6790b9e7-eb53-4c32-9c1c-2e949c8c0be5 req-aa56a317-499c-4423-9dea-909cac6313e8 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1793065 Nov 15 12:47:47.754157 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-b99fdfbd-4df1-4f91-84f8-670d94ad45c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:47.755646 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-b99fdfbd-4df1-4f91-84f8-670d94ad45c5 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7e6e34e4-b05e-4c98-9266-31ca11e16a97&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0568795 Nov 15 12:47:47.874607 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-aaa02cbe-92c7-4681-9ab9-76c748308724 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959990 Nov 15 12:47:47.979915 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b1a739e2-e6f2-4d14-a1c1-8a9c049e5202 req-4c062c80-0ec7-4eba-8aca-84b7430651b9 service neutron] 10.222.0.61 "GET /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966306 Nov 15 12:47:48.058402 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ddb684-3950-4476-8cff-a4baff94011a req-8b8eaf1c-1e99-4824-a8ab-12cdd7075187 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:48.059909 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-69ddb684-3950-4476-8cff-a4baff94011a req-8b8eaf1c-1e99-4824-a8ab-12cdd7075187 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0517735 Nov 15 12:47:48.112375 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-69ddb684-3950-4476-8cff-a4baff94011a req-369d4c68-4ef9-42bf-bb27-f9da21b4cfee tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462487 Nov 15 12:47:48.233612 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ff1f4d-e610-49d0-b6cc-c25005dc7741 req-3e0efe9f-6315-47af-9576-3d6658d90138 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:48.235078 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f8ff1f4d-e610-49d0-b6cc-c25005dc7741 req-3e0efe9f-6315-47af-9576-3d6658d90138 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0509038 Nov 15 12:47:48.285568 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f8ff1f4d-e610-49d0-b6cc-c25005dc7741 req-b7598de9-f374-4109-986d-9766eba983d9 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445402 Nov 15 12:47:48.307983 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56408) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:47:48.347452 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55e321ca-b0e3-46b6-80e0-87f0b6c98fcf tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:48.348983 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-55e321ca-b0e3-46b6-80e0-87f0b6c98fcf tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1093 time: 0.0399897 Nov 15 12:47:48.351684 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56414) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:47:48.356255 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address': '172.20.0.6'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:47:48.390544 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:48.560390 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:48.680212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.27.0.161 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/6e25fdfb-620e-4df7-8353-71b7f74b78ee) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:47:48.839194 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:48.844681 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bd420f-e274-4ce2-a80b-ec340557b9b5 req-cf032481-33f9-4381-a7b7-e9fbffbc2bb0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:48.847236 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-45bd420f-e274-4ce2-a80b-ec340557b9b5 req-cf032481-33f9-4381-a7b7-e9fbffbc2bb0 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0600843 Nov 15 12:47:48.901322 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:48.907194 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-45bd420f-e274-4ce2-a80b-ec340557b9b5 req-0601b065-44f7-4817-b12f-63a5e6cc09e2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488219 Nov 15 12:47:48.982831 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:47:48.987962 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:47:48.994734 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:47:48.999568 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=6e25fdfb-620e-4df7-8353-71b7f74b78ee,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:49.031965 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.032328 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.032668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.033001 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.033326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.033664 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.033991 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.034314 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.034636 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.034957 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.035274 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.035589 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:47:49.437651 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:49.513625 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:49.697929 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:49.703774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:49.773369 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=6e25fdfb-620e-4df7-8353-71b7f74b78ee,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:47:49.795654 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:49.989935 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP b480dbe5-e37c-437f-82f0-dc1d144359fa associated. External IP: 172.27.0.161, port: 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a. Nov 15 12:47:50.163478 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83ea304-6f1b-4d0d-92d9-9fc11f0af734 req-a7dff16b-8b6c-4df8-8f29-150dcd298525 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:50.171255 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b83ea304-6f1b-4d0d-92d9-9fc11f0af734 req-a7dff16b-8b6c-4df8-8f29-150dcd298525 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0851817 Nov 15 12:47:50.290116 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b83ea304-6f1b-4d0d-92d9-9fc11f0af734 req-ef63e99a-e530-4327-b8f4-bc789eb50961 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1168163 Nov 15 12:47:50.354699 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:47:50.490609 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:47:50.505190 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:47:50.521173 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:47:50.525335 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:47:50.526655 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:47:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:50.585013 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a9b75ed6-3efd-4690-9e93-24274241739d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2228022 Nov 15 12:47:50.585013 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:47:50.585013 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e83a0752-870b-4bc4-925a-c664bac7f10e" -d '{"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:47:50.637449 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:47:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-325ba372-390f-49fb-b09d-3ff84a6b048a x-openstack-request-id: req-325ba372-390f-49fb-b09d-3ff84a6b048a {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:47:50.638650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:47:50.640929 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-325ba372-390f-49fb-b09d-3ff84a6b048a {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:47:50.641854 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'status': 'completed', 'code': 200} Nov 15 12:47:50.702876 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:47:51.045731 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:49Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:51.081227 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:47:51.090209 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:47:51.090871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:47:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:51.232852 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:47:51.429331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcece84c-3eca-4888-bb7f-4fcd97883b76 req-a318fa9d-5d9a-49ed-88b8-443bdc4a2fd9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:51.430964 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dcece84c-3eca-4888-bb7f-4fcd97883b76 req-a318fa9d-5d9a-49ed-88b8-443bdc4a2fd9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0638242 Nov 15 12:47:51.509632 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dcece84c-3eca-4888-bb7f-4fcd97883b76 req-e8046ad9-4f62-4346-967f-50b93ab3ca2c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668571 Nov 15 12:47:51.552986 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:49Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:47:51.580945 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10d3f84-7d56-4371-87c2-df20619e756d None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:49Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:47:51.816088 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-efcc1ab0-153e-4604-9e99-74c5dce6ade6 None None] New status for floating IP b480dbe5-e37c-437f-82f0-dc1d144359fa: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:47:52.655055 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bcb02c-f928-4512-b453-1a7c413ba7d0 req-911abda7-df8c-4b33-a6f6-c80ea56386c7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:52.657224 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9bcb02c-f928-4512-b453-1a7c413ba7d0 req-911abda7-df8c-4b33-a6f6-c80ea56386c7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0737610 Nov 15 12:47:52.717167 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9bcb02c-f928-4512-b453-1a7c413ba7d0 req-dee01783-fd38-4ce4-8ba9-be58be25d5a5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478945 Nov 15 12:47:53.873531 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63551a5f-4f3f-4c57-b101-a1cf9fbff6d2 req-cb8a165e-413d-45f8-a8d7-5de6826159be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:53.875035 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63551a5f-4f3f-4c57-b101-a1cf9fbff6d2 req-cb8a165e-413d-45f8-a8d7-5de6826159be tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0535088 Nov 15 12:47:53.944145 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-63551a5f-4f3f-4c57-b101-a1cf9fbff6d2 req-143e2f02-e734-41db-9387-1109ac491f6c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616264 Nov 15 12:47:55.113027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba4545b-ddc9-4fa8-9af2-dea5b29fd3a5 req-b577c8ef-8011-4999-91dd-72e84afd1550 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:55.114511 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eba4545b-ddc9-4fa8-9af2-dea5b29fd3a5 req-b577c8ef-8011-4999-91dd-72e84afd1550 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0728483 Nov 15 12:47:55.170114 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-eba4545b-ddc9-4fa8-9af2-dea5b29fd3a5 req-16de7f10-84d4-453e-88d4-0c84586acdf5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484724 Nov 15 12:47:56.327426 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f65a583-d345-4891-83cd-d7470e16942c req-6597f898-2102-4dcb-9c91-26865d431e42 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:56.335212 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f65a583-d345-4891-83cd-d7470e16942c req-6597f898-2102-4dcb-9c91-26865d431e42 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0694516 Nov 15 12:47:56.386944 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2f65a583-d345-4891-83cd-d7470e16942c req-c255a972-12cc-4aec-b576-911b025c3488 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509739 Nov 15 12:47:57.521902 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cf74e9-8b68-48fd-8f90-3b843bd7ff7d req-c95cd222-bf6b-43bf-8138-57acaeed43fd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:57.523355 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c5cf74e9-8b68-48fd-8f90-3b843bd7ff7d req-c95cd222-bf6b-43bf-8138-57acaeed43fd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0538001 Nov 15 12:47:57.589170 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c5cf74e9-8b68-48fd-8f90-3b843bd7ff7d req-39a41561-3b90-4d73-961a-c3fe36cef3e9 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581779 Nov 15 12:47:58.736774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091c41e3-a03d-4939-acd9-2e0fb7aba387 req-26a74a14-4c9f-42af-bc9b-603a143705d4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:47:58.739713 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-091c41e3-a03d-4939-acd9-2e0fb7aba387 req-26a74a14-4c9f-42af-bc9b-603a143705d4 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0705278 Nov 15 12:47:58.800533 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-091c41e3-a03d-4939-acd9-2e0fb7aba387 req-5d9cf02c-5e32-4ea5-9c93-6374d509f539 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518305 Nov 15 12:48:00.000906 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ec3f3b-e6f6-43f6-bbf7-26b747d0e752 req-93a61f81-b2df-48b4-8e41-5ed287ef210a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:00.003266 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-72ec3f3b-e6f6-43f6-bbf7-26b747d0e752 req-93a61f81-b2df-48b4-8e41-5ed287ef210a tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0774522 Nov 15 12:48:00.067564 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-72ec3f3b-e6f6-43f6-bbf7-26b747d0e752 req-52b28a82-8932-4c32-83cb-8d4e1f857b08 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563223 Nov 15 12:48:00.860749 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-d46bec1f-a170-418f-bdff-b1fc18ac81c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:00.862240 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-d46bec1f-a170-418f-bdff-b1fc18ac81c3 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1098 time: 0.0423687 Nov 15 12:48:00.953849 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-e61313e7-5234-4342-bd7f-748494251752 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:00.955363 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-e61313e7-5234-4342-bd7f-748494251752 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.0862236 Nov 15 12:48:01.052678 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-1310d759-7c59-4b3c-afdf-c28841635d19 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 1001 time: 0.0625114 Nov 15 12:48:01.109761 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-073de5b2-235f-48e0-80fa-c5794f13afce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:01.111238 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-073de5b2-235f-48e0-80fa-c5794f13afce service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0488513 Nov 15 12:48:01.179842 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-d6ca4058-2ed1-4098-9d14-34f132c7aa95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:01.187949 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-d6ca4058-2ed1-4098-9d14-34f132c7aa95 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0571351 Nov 15 12:48:01.227100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d11387c-90c9-489f-bde6-9c0c1bc9cfc4 req-5a067fca-8d08-4fe1-a866-5ee5bf264eb2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:01.229114 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d11387c-90c9-489f-bde6-9c0c1bc9cfc4 req-5a067fca-8d08-4fe1-a866-5ee5bf264eb2 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0621712 Nov 15 12:48:01.282270 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d11387c-90c9-489f-bde6-9c0c1bc9cfc4 req-4e251793-e637-4fff-828e-07281891b17d tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452049 Nov 15 12:48:01.299117 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-07a0397c-62ca-4116-8b9a-30ffc88515a2 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077673 Nov 15 12:48:01.403910 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e83a0752-870b-4bc4-925a-c664bac7f10e req-de6161fe-54e8-4f15-9682-f6a53f72ab16 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892944 Nov 15 12:48:02.414189 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f42752d0-6101-44d4-a02d-6e32c0643def req-c65fa7f0-ab84-41b7-92a4-a4865de922cd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:02.415978 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f42752d0-6101-44d4-a02d-6e32c0643def req-c65fa7f0-ab84-41b7-92a4-a4865de922cd tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0493827 Nov 15 12:48:02.469706 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f42752d0-6101-44d4-a02d-6e32c0643def req-63643f9a-3bf0-4dd5-b4d8-436039c2043c tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467377 Nov 15 12:48:03.338790 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-97d695ae-606c-4173-b274-962634a12628 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:03.598697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d8f965-c882-4c57-88a1-769a8ce8b262 req-89be92b2-d694-49f4-8425-ce70dfce5d58 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:03.600239 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-17d8f965-c882-4c57-88a1-769a8ce8b262 req-89be92b2-d694-49f4-8425-ce70dfce5d58 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 943 time: 0.0529597 Nov 15 12:48:03.652938 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-17d8f965-c882-4c57-88a1-769a8ce8b262 req-0852a422-6aff-4ae1-b035-b2d396179add tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466218 Nov 15 12:48:03.743684 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:48:03.850406 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:03.861531 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'f03748f1-6421-4492-82d3-c659e117188c', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'port_id': 'f03748f1-6421-4492-82d3-c659e117188c', 'mac_address': 'fa:16:3e:30:23:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 611, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:48:03.899351 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:03.916891 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f03748f1-6421-4492-82d3-c659e117188c {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:48:03.936360 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:03.941047 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:03.998806 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=9']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:04.310616 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['f03748f1-6421-4492-82d3-c659e117188c'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:48:05.067026 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9747580-40b3-4adc-a1ef-84a59303956e req-487bb00c-978c-488a-885a-bbd8f5b20e0f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:05.068590 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9747580-40b3-4adc-a1ef-84a59303956e req-487bb00c-978c-488a-885a-bbd8f5b20e0f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 944 time: 0.3055220 Nov 15 12:48:05.120483 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d9747580-40b3-4adc-a1ef-84a59303956e req-fa70e4d1-f954-4684-88f9-a225a8166b0f tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459754 Nov 15 12:48:05.742191 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:48:05.792830 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b0e9f051-e3d3-4671-a731-184f105b895c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:05.805522 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port f03748f1-6421-4492-82d3-c659e117188c triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:48:05.805883 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:05.884948 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:05.913357 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:05.915918 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e999a53c-0c26-48c6-a36f-bd9ccc387981" -d '{"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:05.931882 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:05.938581 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:05.962711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b9bb1e4e-efa7-43b1-8481-5ed70e4e59d2 x-openstack-request-id: req-b9bb1e4e-efa7-43b1-8481-5ed70e4e59d2 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:05.963059 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-plugged", "status": "completed", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:05.963257 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-b9bb1e4e-efa7-43b1-8481-5ed70e4e59d2 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:05.963598 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'code': 200} Nov 15 12:48:06.006255 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=10']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:06.248102 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e29b9bb-7c89-4583-947a-6c4e1bc630e6 req-fd1ea408-0701-46a8-b514-ec7ed7e2a49d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:06.249632 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3e29b9bb-7c89-4583-947a-6c4e1bc630e6 req-fd1ea408-0701-46a8-b514-ec7ed7e2a49d service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 1099 time: 0.0825222 Nov 15 12:48:06.274574 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970cc2a7-1045-4ae6-a27c-26f6d743bece req-8bf2411d-5730-4677-b9ba-9fb2d31966b6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:06.275918 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-970cc2a7-1045-4ae6-a27c-26f6d743bece req-8bf2411d-5730-4677-b9ba-9fb2d31966b6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0673685 Nov 15 12:48:06.332096 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3e29b9bb-7c89-4583-947a-6c4e1bc630e6 req-beb77ede-f897-4297-8158-b7eb0313c739 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0709336 Nov 15 12:48:06.344045 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-970cc2a7-1045-4ae6-a27c-26f6d743bece req-a04ceed0-c8f1-4999-b2d6-50ec0b8d13f7 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607128 Nov 15 12:48:06.881767 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:07.477451 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea4a3d1-a80b-43ac-b1f7-49ddbd9c7a58 req-74fb568f-2048-4c57-afcd-96c7e7e5aec6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:07.479008 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7ea4a3d1-a80b-43ac-b1f7-49ddbd9c7a58 req-74fb568f-2048-4c57-afcd-96c7e7e5aec6 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0554829 Nov 15 12:48:07.534270 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7ea4a3d1-a80b-43ac-b1f7-49ddbd9c7a58 req-5c22dd78-531d-4cec-a912-2af5514c11c5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489798 Nov 15 12:48:08.350032 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:08.678266 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a6ded8c-1a40-4d4c-93ff-c02c35bac543 req-19ad04a6-8ed2-4616-858e-4a9fee8568b5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:08.679807 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8a6ded8c-1a40-4d4c-93ff-c02c35bac543 req-19ad04a6-8ed2-4616-858e-4a9fee8568b5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0529571 Nov 15 12:48:08.730643 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8a6ded8c-1a40-4d4c-93ff-c02c35bac543 req-283959a4-0b7f-4a14-a0ee-5fefe1fb9197 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434098 Nov 15 12:48:09.136911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:14.119125 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:17.763197 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:48:19.260157 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517b4f7f-3fb7-44fc-b67c-d770e81860ef req-a68b2ae8-2449-4c58-85e1-74138bc29ed6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:19.261590 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-517b4f7f-3fb7-44fc-b67c-d770e81860ef req-a68b2ae8-2449-4c58-85e1-74138bc29ed6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0561566 Nov 15 12:48:19.310827 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-517b4f7f-3fb7-44fc-b67c-d770e81860ef req-98d22a0d-1fc6-4a5b-9454-5ff3490cd0d8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430152 Nov 15 12:48:20.432279 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405f11ab-7510-49dc-bf93-9ad7cd408956 req-7acfc7c6-454b-4549-a0c7-d4b26b424e8f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:20.433784 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-405f11ab-7510-49dc-bf93-9ad7cd408956 req-7acfc7c6-454b-4549-a0c7-d4b26b424e8f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0500240 Nov 15 12:48:20.485881 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-405f11ab-7510-49dc-bf93-9ad7cd408956 req-6eac6ca3-cde9-4f12-b6ba-5d8ec073b684 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456202 Nov 15 12:48:21.542085 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-644dd265-9d45-4ecc-b039-57616eea9542 req-c80f3064-e756-4a18-90c2-5104926d62f1 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:21.543616 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-644dd265-9d45-4ecc-b039-57616eea9542 req-c80f3064-e756-4a18-90c2-5104926d62f1 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0513012 Nov 15 12:48:21.609465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc6806e-d8a0-4676-8bba-320658158b21 req-92151f38-162b-4b16-86a5-deac29617d3c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:21.610933 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0dc6806e-d8a0-4676-8bba-320658158b21 req-92151f38-162b-4b16-86a5-deac29617d3c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 946 time: 0.0538387 Nov 15 12:48:21.639132 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Deleting port 2074d291-306a-482f-9039-58a67e582e39 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:21.639474 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:21.666436 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0dc6806e-d8a0-4676-8bba-320658158b21 req-97462856-e985-4380-8c95-4dc29896e3b7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=bf1466de-656b-4213-a69b-ba18bc969d25&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492322 Nov 15 12:48:21.733080 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] For port 2074d291-306a-482f-9039-58a67e582e39, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=2074d291-306a-482f-9039-58a67e582e39,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:21.733437 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:21.905299 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:21.905603 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:21.905918 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Floating IP c75d5182-3626-4f21-b9ea-02821bffadd1 disassociated. External IP: 172.27.0.80, port: 2074d291-306a-482f-9039-58a67e582e39. Nov 15 12:48:21.906260 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Calling delete_port for 2074d291-306a-482f-9039-58a67e582e39 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:22.038625 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:22.068651 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'Port': ['ID=2074d291-306a-482f-9039-58a67e582e39,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:22.081024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.081368 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.081702 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.082031 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.082355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.082694 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.083005 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.083337 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.083647 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.083960 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.084300 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.084613 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:22.192769 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:48:22.297936 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:48:22.309011 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:48:22.320162 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:22.320870 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:22.338715 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] No DVR routers for this DVR port 2074d291-306a-482f-9039-58a67e582e39 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:48:22.342934 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:22.344934 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-644dd265-9d45-4ecc-b039-57616eea9542 req-6b25b21f-43fe-4812-bb34-eb53aec748e3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "DELETE /v2.0/ports/2074d291-306a-482f-9039-58a67e582e39 HTTP/1.1" status: 204 len: 173 time: 0.7925355 Nov 15 12:48:22.345372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'name': 'network-vif-deleted', 'tag': '2074d291-306a-482f-9039-58a67e582e39'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:22.347805 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca89e91c-0cd0-48b1-a24b-321c5c80dfb8" -d '{"events": [{"server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "name": "network-vif-deleted", "tag": "2074d291-306a-482f-9039-58a67e582e39"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:22.398140 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33560fa1-186b-4e1d-a085-67eadf478dac x-openstack-request-id: req-33560fa1-186b-4e1d-a085-67eadf478dac {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:22.398431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f41a6f27-a699-4272-a4aa-6b7fc08747e4", "name": "network-vif-deleted", "tag": "2074d291-306a-482f-9039-58a67e582e39", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:22.398679 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-33560fa1-186b-4e1d-a085-67eadf478dac {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:22.399074 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f41a6f27-a699-4272-a4aa-6b7fc08747e4', 'name': 'network-vif-deleted', 'tag': '2074d291-306a-482f-9039-58a67e582e39', 'status': 'completed', 'code': 200} Nov 15 12:48:22.439502 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:22.800136 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:22.808057 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-c845623c-e444-402e-b420-928878157d1a req-e1ce7cf8-0790-4590-896b-ea104f588481 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f41a6f27-a699-4272-a4aa-6b7fc08747e4 HTTP/1.1" status: 200 len: 210 time: 0.0388987 Nov 15 12:48:22.833657 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:48:22.844978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:22.845603 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:22.973952 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:23.183042 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:23.217630 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede7f3bb-339c-43c0-82b8-7fe06e79b324 None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:48:23.439403 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e819794-18e8-4708-b019-e8ed5e7ecf58 None None] New status for floating IP c75d5182-3626-4f21-b9ea-02821bffadd1: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:48:23.900003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56536) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:23.952781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:23.975576 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.022868 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.026524 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.027648 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "DELETE /v2.0/security-groups/bf1466de-656b-4213-a69b-ba18bc969d25 HTTP/1.1" status: 204 len: 168 time: 0.1266222 Nov 15 12:48:24.031243 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56538) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:24.037369 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87810806-452d-4006-8a3c-6f34c9b636fc tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf1466de-656b-4213-a69b-ba18bc969d25,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:24.053458 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.api.v2.resource [None req-6048ce4b-47b7-425f-81ab-55830572be65 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] show failed (client error): The resource could not be found. Nov 15 12:48:24.054858 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6048ce4b-47b7-425f-81ab-55830572be65 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups/bf1466de-656b-4213-a69b-ba18bc969d25 HTTP/1.1" status: 404 len: 347 time: 0.0221424 Nov 15 12:48:24.057894 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56540) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:24.195189 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Deleting port 84eec597-2a6c-441f-8978-86b5b3b35393 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:24.195507 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.270128 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.270444 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.281936 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Calling delete_port for 84eec597-2a6c-441f-8978-86b5b3b35393 owned by network:floatingip {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:24.416858 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.442914 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'Port': ['ID=84eec597-2a6c-441f-8978-86b5b3b35393,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:24.505614 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.508165 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.509317 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a4e26aea-7aa3-407c-9b61-2be36ff25376 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "DELETE /v2.0/floatingips/c75d5182-3626-4f21-b9ea-02821bffadd1 HTTP/1.1" status: 204 len: 168 time: 0.4501686 Nov 15 12:48:24.680933 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56544) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:24.686334 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1712945079', 'description': 'tempest-description--852994311'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:24.708154 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.775576 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.780036 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.816394 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.817585 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1352389 Nov 15 12:48:24.820690 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56546) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:24.825350 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d66501-403c-4b46-8e4d-01423509e6ef tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroup': ['ID=57590bd3-033b-4647-baa1-b4695e0b4f51,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:24.825572 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group_rule': {'security_group_id': '57590bd3-033b-4647-baa1-b4695e0b4f51', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:24.852056 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.900321 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.905145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.925007 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61d2edef-18c4-4af7-bdb6-854b17293ea6,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:24.932605 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:24.933804 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-98a78d50-40bb-40c7-916a-b9c82cef2364 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1120360 Nov 15 12:48:24.936666 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56548) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:24.940927 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'security_group_rule': {'security_group_id': '57590bd3-033b-4647-baa1-b4695e0b4f51', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:24.967026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.031339 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.035054 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.051247 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=45114d92-6d98-4dcb-9b7d-7f51e134c046,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:25.062049 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.063227 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c1704b1e-fee4-4d30-bc78-4398ce1ccbd4 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1256497 Nov 15 12:48:25.066610 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56550) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:25.071073 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:25.091904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.190465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.290189 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Allocated IP 172.27.0.28 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/74612d34-2462-406a-aac6-227b6172af6c) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:48:25.396201 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.682937 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.717354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:48:25.721934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:48:25.725301 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:48:25.747192 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=74612d34-2462-406a-aac6-227b6172af6c,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:25.808960 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.835130 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 2074d291-306a-482f-9039-58a67e582e39 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:48:25.847623 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.855507 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 2074d291-306a-482f-9039-58a67e582e39 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:48:25.855854 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 2074d291-306a-482f-9039-58a67e582e39 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:48:25.992446 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:25.997067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:26.063460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=74612d34-2462-406a-aac6-227b6172af6c,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:26.076709 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:26.092735 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:26.094589 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8116d16c-73e0-41a8-81e4-f555422f6844 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.0268979 Nov 15 12:48:26.290203 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-224af5ba-8c2c-4bfe-954f-50f2b29abab9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-securitygroup--1712945079&fields=id&tenant_id=36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 267 time: 0.0427153 Nov 15 12:48:26.397781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-4e27994a-04e1-4c78-a4ff-bf0775d69a70 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:26.399722 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-4e27994a-04e1-4c78-a4ff-bf0775d69a70 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 810 time: 0.1014812 Nov 15 12:48:26.414221 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-5343cc33-df3e-4565-80e1-d6c450f4154c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/quotas/36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 375 time: 0.0093503 Nov 15 12:48:26.472469 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-31680986-ea29-4186-8125-543c9b9cf24b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0526206 Nov 15 12:48:26.576404 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-c35e2c2c-d0da-4e50-9f05-0d90a4c5cfe1 service neutron] 10.222.0.44 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0924251 Nov 15 12:48:26.665585 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-52eb9b8f-72a6-4c2e-ada2-a3ff6be52e49 service neutron] 10.222.0.44 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821199 Nov 15 12:48:26.827623 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6ad8001d-a580-4d8e-91c8-b21f897864c4 req-c75a18b2-bb80-44c3-811d-a80152c416b5 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 210 time: 0.0269384 Nov 15 12:48:27.883793 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ae203c7d-1aac-49a6-bf9b-ea8544d748ab tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:27.885309 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ae203c7d-1aac-49a6-bf9b-ea8544d748ab tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 810 time: 0.1136875 Nov 15 12:48:27.927751 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-782f522d-70b6-483f-bd64-8973153f3a40 req-5155cdf4-50ed-4fb7-af80-f16ad5b3c915 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 210 time: 0.0289791 Nov 15 12:48:27.989175 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-d44dffe6-5477-4fd1-bf4c-e6c107a3ce5a tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36f242c4967546e1b9d3186179668c38 HTTP/1.1" status: 200 len: 380 time: 0.0580611 Nov 15 12:48:28.003240 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'port': {'device_id': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'admin_state_up': True, 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'security_groups': ['57590bd3-033b-4647-baa1-b4695e0b4f51']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:28.115448 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Made reservation on behalf of 36f242c4967546e1b9d3186179668c38 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:48:28.118844 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.250529 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Allocated IP 172.20.0.11 (d674a754-ca11-4d5c-be9e-426d0c193bcb/925098dd-312e-4533-8590-2a9da45326c8/efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:48:28.388335 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.420143 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.464987 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Network d674a754-ca11-4d5c-be9e-426d0c193bcb is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:48:28.468741 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:48:28.472641 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:48:28.495627 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event updated for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:28.525915 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:28.526526 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.544365 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-ab9bb28b-c453-4bce-847e-36804752238e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5468543 Nov 15 12:48:28.568505 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Request body: {'port': {'device_id': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:28.628470 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.720833 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-87438c33-783e-4d62-9402-a93a6b070b22 None None] Provisioning complete for port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:48:28.721451 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-87438c33-783e-4d62-9402-a93a6b070b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.754696 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-87438c33-783e-4d62-9402-a93a6b070b22 None None] Port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:48:28.892505 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:48:28.899755 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.911463 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Transition to ACTIVE for port object efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:48:28.916588 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:28.975529 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Pushing event updated for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:29.089077 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3930b6b-4933-4976-af4f-aefb9e70d98f req-a985e7e7-52ff-477e-b6a5-7b96a8ca9b0f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.090655 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f3930b6b-4933-4976-af4f-aefb9e70d98f req-a985e7e7-52ff-477e-b6a5-7b96a8ca9b0f tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 944 time: 0.0865498 Nov 15 12:48:29.096325 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Attempting to bind port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:48:29.096890 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Attempting to bind port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:48:29.097212 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Attempting to bind port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:48:29.109121 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 on network d674a754-ca11-4d5c-be9e-426d0c193bcb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:48:29.109439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Attempting to bind port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 on network d674a754-ca11-4d5c-be9e-426d0c193bcb {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:48:29.122934 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 48, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:48:29.123269 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Checking segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:48:29.123647 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Bound using segment: {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:48:29.124658 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Bound port: efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6b28e91b-fc67-429b-a574-ffea38211fc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:48:29.125014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:29.158984 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f3930b6b-4933-4976-af4f-aefb9e70d98f req-18adfe3b-a405-431c-bb78-ec75b5757a86 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593390 Nov 15 12:48:29.214533 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:48:29.218130 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:48:29.221822 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:29.263271 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.264254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:29.266326 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] 10.222.0.61 "PUT /v2.0/ports/efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 HTTP/1.1" status: 200 len: 1094 time: 0.7021570 Nov 15 12:48:29.266980 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:29.270366 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82150c02-f1fc-44a7-9ba5-0008b8a1a101" -d '{"events": [{"name": "network-changed", "server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:29.309296 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e723bcf-2d9c-4b45-b10c-b582c008150d service neutron] Pushing event updated for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:29.318557 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f977d6af-36bd-439c-9df1-4657d3dc7b00 x-openstack-request-id: req-f977d6af-36bd-439c-9df1-4657d3dc7b00 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:29.318976 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:29.319493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-f977d6af-36bd-439c-9df1-4657d3dc7b00 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:29.320318 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'status': 'completed', 'code': 200} Nov 15 12:48:29.407165 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-8967c3fc-37c7-4f6c-9fcd-37a2063f51e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.409296 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-8967c3fc-37c7-4f6c-9fcd-37a2063f51e1 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 1097 time: 0.0487790 Nov 15 12:48:29.464864 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-8e916d34-fea5-48b3-89a8-e13077a82efa service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 HTTP/1.1" status: 200 len: 217 time: 0.0375302 Nov 15 12:48:29.521025 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-8e8fb9de-4fc8-441f-8fa9-1db6301fa0cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.522481 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-8e8fb9de-4fc8-441f-8fa9-1db6301fa0cc service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0501111 Nov 15 12:48:29.571133 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9cd90efe-9624-4820-9128-b3c2ca344967 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.572569 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-9cd90efe-9624-4820-9128-b3c2ca344967 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0406644 Nov 15 12:48:29.665026 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-36a2fd59-3b5f-40ac-99b2-5f4dbf2c4d26 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849500 Nov 15 12:48:29.757403 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-757deaf1-1574-4303-b564-4485a50bdec1 req-a4261a95-8925-461b-b42f-1f6bef4f644d service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825009 Nov 15 12:48:29.908827 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-ac975732-f4a8-44d4-bd1b-8d5d5a8a7783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:29.910435 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-ac975732-f4a8-44d4-bd1b-8d5d5a8a7783 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 1097 time: 0.0461428 Nov 15 12:48:30.012689 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-2a454b59-eb25-4f72-b6d5-02d0825631c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:30.014162 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-2a454b59-eb25-4f72-b6d5-02d0825631c0 service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.0898345 Nov 15 12:48:30.065630 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-dc076014-4e2a-42ec-9618-72242128acb0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 HTTP/1.1" status: 200 len: 217 time: 0.0402217 Nov 15 12:48:30.130800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-1aa062ea-7afa-4725-ba74-d3fce951d32f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:30.132502 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-1aa062ea-7afa-4725-ba74-d3fce951d32f service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0560627 Nov 15 12:48:30.180215 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-510a5112-700c-423b-b5ea-146769004308 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:30.181721 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-510a5112-700c-423b-b5ea-146769004308 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418997 Nov 15 12:48:30.307801 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f878d63a-4449-4d35-bcb6-015d565bed24 req-5b9b8211-897f-450a-b567-f3c440d9d14e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:30.309205 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f878d63a-4449-4d35-bcb6-015d565bed24 req-5b9b8211-897f-450a-b567-f3c440d9d14e tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 944 time: 0.0746422 Nov 15 12:48:30.328503 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-3ab9b330-87f0-434d-bbc9-30c5d8ff37e2 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1378632 Nov 15 12:48:30.415780 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f878d63a-4449-4d35-bcb6-015d565bed24 req-edfdc2fb-88dd-4eae-960a-d5f4e7fdb3ce tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995376 Nov 15 12:48:30.450701 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-82150c02-f1fc-44a7-9ba5-0008b8a1a101 req-b1914827-7b4f-40a3-b3f8-ad5a5c26f331 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1139565 Nov 15 12:48:31.539284 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33844ba4-ca37-444d-8f80-2b97a0b860a2 req-a3a000cd-1714-48b8-90a9-3f1a46624de3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:31.541117 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-33844ba4-ca37-444d-8f80-2b97a0b860a2 req-a3a000cd-1714-48b8-90a9-3f1a46624de3 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 944 time: 0.0537744 Nov 15 12:48:31.588520 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-33844ba4-ca37-444d-8f80-2b97a0b860a2 req-8287f21e-67c7-4484-b6f8-cc87ac284cff tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409203 Nov 15 12:48:31.863031 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:48:31.957447 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:31.969556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'port_id': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'mac_address': 'fa:16:3e:ef:99:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 603, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:48:32.009815 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:32.023631 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:48:32.043334 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:32.047349 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:32.096755 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:32.105171 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.105509 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.105838 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.106166 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.106487 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.106808 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.107127 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.107444 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.107761 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.108076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.108985 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.109310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:32.363677 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:48:32.717978 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1c58ee-71ea-4ffc-b505-2dd0c8b7fa6b req-13fbfabc-200b-4b5d-9db2-def8f161d396 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:32.720234 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e1c58ee-71ea-4ffc-b505-2dd0c8b7fa6b req-13fbfabc-200b-4b5d-9db2-def8f161d396 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 945 time: 0.0596490 Nov 15 12:48:32.770583 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-1e1c58ee-71ea-4ffc-b505-2dd0c8b7fa6b req-827d9cc4-f168-447b-9aaa-1705e746bed6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443370 Nov 15 12:48:33.342026 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-330d0454-4347-4336-a9b5-59159d541c92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:33.862860 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:48:33.891720 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e000de8-b02e-4c11-9b0e-a9f43978bf5e req-ef2c69a1-6ed8-426d-8119-c43ece9f8da9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:33.893278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e000de8-b02e-4c11-9b0e-a9f43978bf5e req-ef2c69a1-6ed8-426d-8119-c43ece9f8da9 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 945 time: 0.0519481 Nov 15 12:48:33.912762 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:48:33.916997 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:48:33.917409 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:33.944589 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9e000de8-b02e-4c11-9b0e-a9f43978bf5e req-143d870f-d153-4512-9b25-20a3260699d8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441785 Nov 15 12:48:33.997400 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:34.029021 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:34.031252 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1978a1bb-2dd0-4fbd-bc20-8baa4847767d" -d '{"events": [{"server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "name": "network-vif-plugged", "status": "completed", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:34.044810 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:34.048838 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:34.076848 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e292d49-2653-46a0-9b51-663d96c66119 x-openstack-request-id: req-2e292d49-2653-46a0-9b51-663d96c66119 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:34.077155 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "name": "network-vif-plugged", "status": "completed", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:34.077396 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-2e292d49-2653-46a0-9b51-663d96c66119 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:34.077781 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'code': 200} Nov 15 12:48:34.104573 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:34.290148 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8903e18c-fc0a-4a48-87b1-93b5decb3789 req-667199cf-0c11-48b9-ae4f-566b1e39bf02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:34.291879 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8903e18c-fc0a-4a48-87b1-93b5decb3789 req-667199cf-0c11-48b9-ae4f-566b1e39bf02 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 1099 time: 0.0387917 Nov 15 12:48:34.340536 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8903e18c-fc0a-4a48-87b1-93b5decb3789 req-71038821-54b1-40a0-a319-12c41c928d3b service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407219 Nov 15 12:48:35.075374 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0ea914-898e-49d7-adba-1be1c144f432 req-d27259fb-b983-4898-b5ce-7033011a49c6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:35.076796 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db0ea914-898e-49d7-adba-1be1c144f432 req-d27259fb-b983-4898-b5ce-7033011a49c6 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0517976 Nov 15 12:48:35.129675 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-db0ea914-898e-49d7-adba-1be1c144f432 req-ab4b18dd-778d-4789-8f23-85f3e6507e36 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464733 Nov 15 12:48:35.775374 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-14adea20-1154-4e7d-bdc3-481d1b7f88d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:36.278504 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbf18dd5-315c-471d-b575-8adc604ea35f req-1d94a506-2206-42b3-9acb-4baac390dfa2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:36.280608 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bbf18dd5-315c-471d-b575-8adc604ea35f req-1d94a506-2206-42b3-9acb-4baac390dfa2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0597589 Nov 15 12:48:36.335582 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-bbf18dd5-315c-471d-b575-8adc604ea35f req-88ecef5a-1c28-4139-a8eb-bc43fd2f4ae7 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489314 Nov 15 12:48:36.506675 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865cd5c5-f817-462a-aa2a-0a5483ed4674 req-44195955-6ccc-4065-9230-7c4b5395c3d8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:36.508420 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-865cd5c5-f817-462a-aa2a-0a5483ed4674 req-44195955-6ccc-4065-9230-7c4b5395c3d8 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0734727 Nov 15 12:48:36.517604 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56606) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:36.522095 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Request body: {'floatingip': {'port_id': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:48:36.561609 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:36.886097 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:37.012675 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:37.018022 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:37.133207 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Floating IP 4983bfb5-1d0b-4f56-8007-41de688cb38a associated. External IP: 172.27.0.28, port: efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33. Nov 15 12:48:37.362701 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:48:37.473115 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:48:37.477687 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:37.484270 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:48:37.495433 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:37.496102 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:37.508778 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8fcacb95-c1fa-404a-a09a-c96ed06caf29 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "PUT /v2.0/floatingips/4983bfb5-1d0b-4f56-8007-41de688cb38a HTTP/1.1" status: 200 len: 991 time: 0.9869678 Nov 15 12:48:37.508778 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:37.508778 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff" -d '{"events": [{"name": "network-changed", "server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:37.561330 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81bd2120-9695-4a0e-9c21-ab72ab4a1509 x-openstack-request-id: req-81bd2120-9695-4a0e-9c21-ab72ab4a1509 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:37.561621 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:37.561874 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-81bd2120-9695-4a0e-9c21-ab72ab4a1509 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:37.562776 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'status': 'completed', 'code': 200} Nov 15 12:48:37.623827 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:37.700012 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-43c6c8ef-efde-40fd-be21-e64c7a67b196 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:37.701542 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-43c6c8ef-efde-40fd-be21-e64c7a67b196 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=36f242c4967546e1b9d3186179668c38&device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 1099 time: 0.0497534 Nov 15 12:48:37.815350 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-8fff7e3a-bded-4eb6-8a20-c366b349a859 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:37.816798 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-8fff7e3a-bded-4eb6-8a20-c366b349a859 service neutron] 10.222.0.61 "GET /v2.0/networks?id=d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 200 len: 911 time: 0.1063168 Nov 15 12:48:37.885478 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-5d86b163-3c97-49e3-8e57-2dc385c22c84 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 HTTP/1.1" status: 200 len: 999 time: 0.0607078 Nov 15 12:48:37.906370 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '4983bfb5-1d0b-4f56-8007-41de688cb38a', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.28', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:ef:99:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:48:25Z', 'updated_at': '2021-11-15T12:48:36Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:37.938812 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:48:37.945037 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-8e709b0e-a6b8-49ee-b556-892d624ae092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:37.946496 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-8e709b0e-a6b8-49ee-b556-892d624ae092 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 200 len: 849 time: 0.0520828 Nov 15 12:48:37.947977 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:37.948644 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:38.019784 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-47b14a41-47fb-4a59-9cae-a5a4553c5ea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:38.022132 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-47b14a41-47fb-4a59-9cae-a5a4553c5ea9 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d674a754-ca11-4d5c-be9e-426d0c193bcb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0655155 Nov 15 12:48:38.064747 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:38.139447 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-f4ca0af8-bda8-418e-b4f4-d5260b688f55 service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1090748 Nov 15 12:48:38.243258 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d80c7eb8-5c10-48c2-a7b8-72a6e79762ff req-29e5bfed-37dc-416b-abe9-9f34f573058a service neutron] 10.222.0.61 "GET /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0952771 Nov 15 12:48:38.315763 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '4983bfb5-1d0b-4f56-8007-41de688cb38a', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.28', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:ef:99:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:48:25Z', 'updated_at': '2021-11-15T12:48:36Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:38.347672 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45184fa2-15ce-4840-a3c9-b5f797a5b6c4 None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': '4983bfb5-1d0b-4f56-8007-41de688cb38a', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'floating_ip_address': '172.27.0.28', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'port_id': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'mac_address': 'fa:16:3e:ef:99:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:48:25Z', 'updated_at': '2021-11-15T12:48:36Z', 'revision_number': 1, 'project_id': '36f242c4967546e1b9d3186179668c38', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:48:38.362355 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:38.576082 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a8caa13-9d35-4601-a537-32cb44a7bea7 None None] New status for floating IP 4983bfb5-1d0b-4f56-8007-41de688cb38a: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:48:39.142053 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:44.119167 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:47.248583 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aee1018-81f1-4963-ba83-2f6e5c9f64ed req-356ab4a9-779d-4479-b292-b77a4c554317 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:47.250147 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7aee1018-81f1-4963-ba83-2f6e5c9f64ed req-356ab4a9-779d-4479-b292-b77a4c554317 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0636961 Nov 15 12:48:47.300290 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-7aee1018-81f1-4963-ba83-2f6e5c9f64ed req-1d658f64-fe78-4a49-9ca1-76fc7fcdd969 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441616 Nov 15 12:48:48.434727 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743f8f60-735c-4477-bf81-902282f798c9 req-3aaca5cc-1260-4b4c-a80f-e9474bdcfebb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:48.436540 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-743f8f60-735c-4477-bf81-902282f798c9 req-3aaca5cc-1260-4b4c-a80f-e9474bdcfebb tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0586133 Nov 15 12:48:48.494771 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-743f8f60-735c-4477-bf81-902282f798c9 req-0fb40821-5d81-49c2-8a46-52cc32f3fb01 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516026 Nov 15 12:48:49.052026 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-3206deed-4427-4929-979f-d8b5abffb5cf tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:49.053499 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-3206deed-4427-4929-979f-d8b5abffb5cf tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0529585 Nov 15 12:48:49.169251 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Deleting port f03748f1-6421-4492-82d3-c659e117188c {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:49.169591 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:49.261880 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] For port f03748f1-6421-4492-82d3-c659e117188c, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=f03748f1-6421-4492-82d3-c659e117188c,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:49.262158 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:49.634405 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1265695d-fa25-4906-8d26-f8fff21b7ede req-1fce69a9-59ef-46c0-971d-eaf91e5db7f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:48:49.636384 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1265695d-fa25-4906-8d26-f8fff21b7ede req-1fce69a9-59ef-46c0-971d-eaf91e5db7f1 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 946 time: 0.0535119 Nov 15 12:48:49.698322 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-1265695d-fa25-4906-8d26-f8fff21b7ede req-cd532e60-9f97-41f9-bd4f-47436c58351b tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups?id=8410d98a-ade6-47fe-97c8-fca1a0ef24ea&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524120 Nov 15 12:48:49.716520 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:49.716747 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:49.717077 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Floating IP 9ecb09d6-1e60-4edf-a022-0125934ee137 disassociated. External IP: 172.27.0.39, port: f03748f1-6421-4492-82d3-c659e117188c. Nov 15 12:48:49.717418 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Calling delete_port for f03748f1-6421-4492-82d3-c659e117188c owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:49.869780 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:49.903734 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'Port': ['ID=f03748f1-6421-4492-82d3-c659e117188c,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:50.036803 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:48:50.155553 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:48:50.166005 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:48:50.178970 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:50.179620 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:50.205322 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] No DVR routers for this DVR port f03748f1-6421-4492-82d3-c659e117188c on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:48:50.208800 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:50.212317 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a73449a7-a33e-4642-a127-2d08eb4e573d req-83085d15-edaf-4221-8fba-2108ab066b6e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.61 "DELETE /v2.0/ports/f03748f1-6421-4492-82d3-c659e117188c HTTP/1.1" status: 204 len: 173 time: 1.1505823 Nov 15 12:48:50.212813 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-deleted', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:48:50.215357 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4936bd7d-ee33-48f9-bb03-67a6703336fb" -d '{"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-deleted", "tag": "f03748f1-6421-4492-82d3-c659e117188c"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:48:50.263916 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:48:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb4a6569-8139-4ed4-ba8e-7cb285f396e6 x-openstack-request-id: req-fb4a6569-8139-4ed4-ba8e-7cb285f396e6 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:48:50.264403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a57f0cb-3da6-4fd3-af67-ffb4480b8f67", "name": "network-vif-deleted", "tag": "f03748f1-6421-4492-82d3-c659e117188c", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:48:50.265547 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-fb4a6569-8139-4ed4-ba8e-7cb285f396e6 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:48:50.266068 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a57f0cb-3da6-4fd3-af67-ffb4480b8f67', 'name': 'network-vif-deleted', 'tag': 'f03748f1-6421-4492-82d3-c659e117188c', 'status': 'completed', 'code': 200} Nov 15 12:48:50.302772 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:50.655005 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:50.685491 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:48:50.695244 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:50.695868 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:50.837537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:50.839400 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6bc5f764-09f7-4740-9c69-c33ed3bfcf15 req-fb480286-986d-41db-9e1e-1ddb7b9a5374 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a57f0cb-3da6-4fd3-af67-ffb4480b8f67 HTTP/1.1" status: 200 len: 210 time: 0.0385885 Nov 15 12:48:51.051697 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:51.079379 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db4d8c4-d5de-40b4-89c6-22909a5091c4 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:39:41Z', 'revision_number': 4, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '4938c78e-9bc9-4df5-bf18-84ed271c479f', 'name': '', 'network_id': '7e6e34e4-b05e-4c98-9266-31ca11e16a97', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'mac_address': 'fa:16:3e:51:38:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:39Z', 'updated_at': '2021-11-15T12:39:50Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'subnets': [{'id': '45ee91be-922e-4559-8cc0-d7bba19c0c19', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:48:51.314249 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dce15f1-a9c2-4595-b1a0-e610891e9228 None None] New status for floating IP 9ecb09d6-1e60-4edf-a022-0125934ee137: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:48:51.939169 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56668) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:51.998136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.022269 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:48:52.023560 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.046410 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: f03748f1-6421-4492-82d3-c659e117188c {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:48:52.046766 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device f03748f1-6421-4492-82d3-c659e117188c not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:48:52.074162 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.076840 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.078580 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "DELETE /v2.0/security-groups/8410d98a-ade6-47fe-97c8-fca1a0ef24ea HTTP/1.1" status: 204 len: 168 time: 0.1378245 Nov 15 12:48:52.081368 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56670) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:52.087663 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8410d98a-ade6-47fe-97c8-fca1a0ef24ea,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:52.094638 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.094788 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.api.v2.resource [None req-3f7bebcc-37c5-46c6-bf69-027124551fb5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] show failed (client error): The resource could not be found. Nov 15 12:48:52.094996 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.095313 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.095628 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3f7bebcc-37c5-46c6-bf69-027124551fb5 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "GET /v2.0/security-groups/8410d98a-ade6-47fe-97c8-fca1a0ef24ea HTTP/1.1" status: 404 len: 347 time: 0.0132551 Nov 15 12:48:52.095795 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.095960 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.096315 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.096639 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.096961 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.097279 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.097598 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.097923 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.098245 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e510bf43-88b9-4038-a733-9c90ef6c8fa8 tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:48:52.098428 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56672) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:52.225943 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Deleting port f60311e0-f678-4ee3-8bab-e7a9af94b729 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:52.226285 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.307337 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.307657 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.320070 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Calling delete_port for f60311e0-f678-4ee3-8bab-e7a9af94b729 owned by network:floatingip {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:52.452428 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.479549 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Pushing event deleted for resources: {'Port': ['ID=f60311e0-f678-4ee3-8bab-e7a9af94b729,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:52.537992 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks [] for floatingip, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.540552 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:52.541970 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-558b7416-1bf9-4d73-aa5f-fe6d7db7d39e tempest-AttachVolumeShelveTestJSON-1113404938 tempest-AttachVolumeShelveTestJSON-1113404938-project] 10.222.0.44 "DELETE /v2.0/floatingips/9ecb09d6-1e60-4edf-a022-0125934ee137 HTTP/1.1" status: 204 len: 168 time: 0.4426749 Nov 15 12:48:54.762743 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:48:54.961302 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56700) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:55.421810 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:55.663272 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Deleting port 4938c78e-9bc9-4df5-bf18-84ed271c479f {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:55.663272 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:55.742024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] For port 4938c78e-9bc9-4df5-bf18-84ed271c479f, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=4938c78e-9bc9-4df5-bf18-84ed271c479f,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:55.742387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:55.754822 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Calling delete_port for 4938c78e-9bc9-4df5-bf18-84ed271c479f owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:55.934691 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:55.961014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Pushing event deleted for resources: {'Port': ['ID=4938c78e-9bc9-4df5-bf18-84ed271c479f,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:56.133819 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:56.350459 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Router 4512181d-cbaf-4499-9428-f436a2106d4f has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:48:56.456457 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:48:56.462005 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-443221f0-eb69-4045-8250-5774bd13d60b admin admin] 10.222.0.44 "PUT /v2.0/routers/4512181d-cbaf-4499-9428-f436a2106d4f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4996753 Nov 15 12:48:56.464523 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56706) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:56.465792 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Sync routers for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:48:56.476110 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:56.476735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:56.568937 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks [] for router, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:56.583567 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:56.670660 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:56.725491 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Deleting port af310350-e94a-4200-b190-cf66fbee7948 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:56.726113 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:56.762845 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65'}], 'enable_snat': True}, 'gw_port_id': 'af310350-e94a-4200-b190-cf66fbee7948', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:48:55Z', 'revision_number': 5, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port': {'id': 'af310350-e94a-4200-b190-cf66fbee7948', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:65:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.65', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:39:35Z', 'updated_at': '2021-11-15T12:39:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:56.798386 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Checking router: 4512181d-cbaf-4499-9428-f436a2106d4f for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:48:56.820381 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Routers {'4512181d-cbaf-4499-9428-f436a2106d4f'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:48:56.821003 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:48:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['4512181d-cbaf-4499-9428-f436a2106d4f'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:56.845555 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] For port af310350-e94a-4200-b190-cf66fbee7948, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=af310350-e94a-4200-b190-cf66fbee7948,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:56.846066 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:56.863061 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Calling delete_port for af310350-e94a-4200-b190-cf66fbee7948 owned by network:router_gateway {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:56.915716 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] Set router 4512181d-cbaf-4499-9428-f436a2106d4f gateway port host: None {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:48:56.966594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:48:56Z', 'revision_number': 6, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:56.995953 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4edc4b51-57a2-466d-942d-8a479357d738 None None] The sync data for ids ['4512181d-cbaf-4499-9428-f436a2106d4f'] in dv-cinder-803823-7-iscsi is: [{'id': '4512181d-cbaf-4499-9428-f436a2106d4f', 'name': 'tempest-AttachVolumeShelveTestJSON-1571600024-router', 'tenant_id': '5e23e880e5674cdb85e83c616f14f549', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:39:34Z', 'updated_at': '2021-11-15T12:48:56Z', 'revision_number': 6, 'project_id': '5e23e880e5674cdb85e83c616f14f549', 'gw_port_host': None}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:48:57.041475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.067995 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Pushing event deleted for resources: {'Port': ['ID=af310350-e94a-4200-b190-cf66fbee7948,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:57.125965 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.218181 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.220391 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.265457 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.266066 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4512181d-cbaf-4499-9428-f436a2106d4f {{(pid=108286) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:48:57.271490 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.272640 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8504d176-ca23-435d-99b7-c0ab1e2a783e admin admin] 10.222.0.44 "DELETE /v2.0/routers/4512181d-cbaf-4499-9428-f436a2106d4f HTTP/1.1" status: 204 len: 168 time: 0.8071759 Nov 15 12:48:57.275192 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56710) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:57.320748 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Deleting subnet 45ee91be-922e-4559-8cc0-d7bba19c0c19 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:48:57.323846 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.363107 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.457263 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.508594 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.532895 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=45ee91be-922e-4559-8cc0-d7bba19c0c19,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:57.542633 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.545987 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-b5f86683-ca8d-4278-bdd0-9f269ed82bb3 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/45ee91be-922e-4559-8cc0-d7bba19c0c19 HTTP/1.1" status: 204 len: 168 time: 0.2698698 Nov 15 12:48:57.547749 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cffbf11b-c839-4d84-ae13-771cb8f25001 None None] Network 7e6e34e4-b05e-4c98-9266-31ca11e16a97 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:48:57.548662 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56712) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:57.619128 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.670492 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Deleting port 66dc9037-19b5-4258-b494-e14e8ce2303d {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:57.670823 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.732824 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] For port 66dc9037-19b5-4258-b494-e14e8ce2303d, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=66dc9037-19b5-4258-b494-e14e8ce2303d,segment=NetworkSegment(11bba09a-fd6b-4b4e-bb1b-95f8a053dee0),segment_id=11bba09a-fd6b-4b4e-bb1b-95f8a053dee0)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:57.733207 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.745718 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Calling delete_port for 66dc9037-19b5-4258-b494-e14e8ce2303d owned by network:dhcp {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:57.786168 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] DHCP port deletion for 7e6e34e4-b05e-4c98-9266-31ca11e16a97 request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:48:57.832752 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.837780 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Deleting port 66dc9037-19b5-4258-b494-e14e8ce2303d {{(pid=108288) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:48:57.838148 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.859008 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Pushing event deleted for resources: {'Port': ['ID=66dc9037-19b5-4258-b494-e14e8ce2303d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:57.863116 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] No DVR routers for this DVR port 66dc9037-19b5-4258-b494-e14e8ce2303d on host dv-cinder-803823-7-iscsi {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:48:57.906683 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] For port 66dc9037-19b5-4258-b494-e14e8ce2303d, host dv-cinder-803823-7-iscsi, got binding levels [] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:48:57.907665 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.930958 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Calling delete_port for 66dc9037-19b5-4258-b494-e14e8ce2303d owned by network:dhcp {{(pid=108288) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:48:57.934546 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.ipam_backend_mixin [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Port 66dc9037-19b5-4258-b494-e14e8ce2303d was not found and therefore no delete operation was performed {{(pid=108288) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 15 12:48:57.935974 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031'] for port, after_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.941202 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:57.962614 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] Pushing event deleted for resources: {'Port': ['ID=66dc9037-19b5-4258-b494-e14e8ce2303d,revision_number=None']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:57.965060 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e6e34e4-b05e-4c98-9266-31ca11e16a97']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:57.966687 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9f1e329-f821-4d81-ac6e-2aa529b059c2 None None] No DVR routers for this DVR port 66dc9037-19b5-4258-b494-e14e8ce2303d on host dv-cinder-803823-7-iscsi {{(pid=108288) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:48:57.979188 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:57.979480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11bba09a-fd6b-4b4e-bb1b-95f8a053dee0') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:48:57.990400 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.004852 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.011972 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Releasing vlan 611 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:48:58.012432 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:48:58.014111 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:48:58.073901 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.079946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.083674 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] 10.222.0.44 "DELETE /v2.0/networks/7e6e34e4-b05e-4c98-9266-31ca11e16a97 HTTP/1.1" status: 204 len: 168 time: 0.5339675 Nov 15 12:48:58.097198 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8c671e-ac38-4653-9030-d7e1466c6ea2 admin admin] Pushing event deleted for resources: {'Network': ['ID=7e6e34e4-b05e-4c98-9266-31ca11e16a97,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:58.208071 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56718) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:58.249188 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e5947033-b276-47b9-9875-81643ce24ebf admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=5e23e880e5674cdb85e83c616f14f549&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0398071 Nov 15 12:48:58.251577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56720) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:48:58.570045 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.591473 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.636613 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.639280 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:48:58.640351 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e5112b0b-194c-4047-9909-f17e76ba7a29 HTTP/1.1" status: 204 len: 168 time: 0.3878319 Nov 15 12:48:58.654562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7ffc52-360b-4c66-b1d2-e6add331e6e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5112b0b-194c-4047-9909-f17e76ba7a29,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:48:58.832980 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 4938c78e-9bc9-4df5-bf18-84ed271c479f no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:48:58.853029 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 4938c78e-9bc9-4df5-bf18-84ed271c479f {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:48:58.853372 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 4938c78e-9bc9-4df5-bf18-84ed271c479f not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:48:58.853785 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device af310350-e94a-4200-b190-cf66fbee7948 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:48:58.872978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: af310350-e94a-4200-b190-cf66fbee7948 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:48:58.873319 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device af310350-e94a-4200-b190-cf66fbee7948 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:48:58.873735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 66dc9037-19b5-4258-b494-e14e8ce2303d no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:48:58.897920 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 66dc9037-19b5-4258-b494-e14e8ce2303d {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:48:58.898372 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 66dc9037-19b5-4258-b494-e14e8ce2303d not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:49:03.343685 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9fd05b17-6f8f-46ab-be3b-c5b76d2ea10d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:05.776754 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-11219ff7-07dd-4e1d-9640-640bc351a7e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:06.885556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.013984 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56836) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:07.132983 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d966a5c-cfbe-4101-8fa6-135c7a2b5f5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.218631 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d966a5c-cfbe-4101-8fa6-135c7a2b5f5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.223141 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d966a5c-cfbe-4101-8fa6-135c7a2b5f5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.262484 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4d966a5c-cfbe-4101-8fa6-135c7a2b5f5b admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=622679c92c5d4657b4c016b780d9b7e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2473536 Nov 15 12:49:07.263332 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d966a5c-cfbe-4101-8fa6-135c7a2b5f5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=157d1372-1fba-4afb-9b19-a63e42520769,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:07.265629 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56840) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:07.315009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.337313 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.384265 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.386920 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:07.388071 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/157d1372-1fba-4afb-9b19-a63e42520769 HTTP/1.1" status: 204 len: 168 time: 0.1215501 Nov 15 12:49:07.402981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b97a714-09bc-4959-bab7-bc58e9c484d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=157d1372-1fba-4afb-9b19-a63e42520769,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:08.354594 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:09.147631 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:14.124627 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:16.804235 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 56972) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:16.910650 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a67d68f6-41ff-4638-afe7-5e448ab51c76 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:16.985465 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a67d68f6-41ff-4638-afe7-5e448ab51c76 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:16.989910 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a67d68f6-41ff-4638-afe7-5e448ab51c76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:17.028747 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a67d68f6-41ff-4638-afe7-5e448ab51c76 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=2f01183f4c2f4112805fb1bac2722c41&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2235360 Nov 15 12:49:17.029515 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67d68f6-41ff-4638-afe7-5e448ab51c76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f9b1eee-5dbb-45d1-8496-fdcf4b44b917,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:17.031269 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 56976) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:17.082642 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:17.103368 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:17.150608 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:17.153437 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:17.154579 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/8f9b1eee-5dbb-45d1-8496-fdcf4b44b917 HTTP/1.1" status: 204 len: 168 time: 0.1217821 Nov 15 12:49:17.163083 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8819dc99-3e83-438c-9e22-08c0e2a3f96d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f9b1eee-5dbb-45d1-8496-fdcf4b44b917,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:18.340175 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57028) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:18.442034 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43bc5138-3143-44e2-8261-9f559b3701a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.513737 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43bc5138-3143-44e2-8261-9f559b3701a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.517367 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-43bc5138-3143-44e2-8261-9f559b3701a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.554806 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-43bc5138-3143-44e2-8261-9f559b3701a5 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=52e46eb7a19c4bf4b69b2644991c811c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2135239 Nov 15 12:49:18.556945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43bc5138-3143-44e2-8261-9f559b3701a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=970d8f12-93f6-4369-9238-95a9d1a69c7c,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:18.557586 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57032) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:18.605121 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.629672 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.679299 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.682086 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:18.683249 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/970d8f12-93f6-4369-9238-95a9d1a69c7c HTTP/1.1" status: 204 len: 168 time: 0.1246927 Nov 15 12:49:18.691780 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82d11382-20e3-4e3d-affd-ca2e4e2eb8da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=970d8f12-93f6-4369-9238-95a9d1a69c7c,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:23.456621 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57148) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:23.571656 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.648378 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.653100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.691129 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=3c5503a5b94e4c57aee2a4c232f22d38&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2333572 Nov 15 12:49:23.694774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57158) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:23.696745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47e20959-d5e3-4a03-8fce-ab2d781eff9b,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:23.703891 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.704269 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.704609 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.704944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.705848 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.706182 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.706581 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.706835 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.707164 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.707496 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.707805 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.708317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-accd4cde-2fd9-4fab-99f9-d0a744aea154 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:23.747747 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.770317 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.818383 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.820971 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:23.822121 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/47e20959-d5e3-4a03-8fce-ab2d781eff9b HTTP/1.1" status: 204 len: 168 time: 0.1253531 Nov 15 12:49:23.830893 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965a5cdd-b21b-4e1f-808e-5e4676e8429a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47e20959-d5e3-4a03-8fce-ab2d781eff9b,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:24.100189 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57164) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:24.116288 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a15bed81-0e3d-46bf-8dca-2af8053d10c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.194018 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a15bed81-0e3d-46bf-8dca-2af8053d10c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.198147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a15bed81-0e3d-46bf-8dca-2af8053d10c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.251425 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a15bed81-0e3d-46bf-8dca-2af8053d10c5 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=28a893ca297b491bb85ecf41e52292d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1497159 Nov 15 12:49:24.253909 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a15bed81-0e3d-46bf-8dca-2af8053d10c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ebce74d-0c6c-44d0-8fa1-a53090dc961a,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:24.254268 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57166) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:24.306943 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.331051 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.382007 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.384658 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:24.385788 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/3ebce74d-0c6c-44d0-8fa1-a53090dc961a HTTP/1.1" status: 204 len: 168 time: 0.1305335 Nov 15 12:49:24.394527 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eede9f84-480d-48d3-b386-919074e2df0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ebce74d-0c6c-44d0-8fa1-a53090dc961a,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:30.670194 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57304) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:30.777175 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6ec4c908-a2a7-4684-a5c7-724b374b33f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:30.854086 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6ec4c908-a2a7-4684-a5c7-724b374b33f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:30.857947 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6ec4c908-a2a7-4684-a5c7-724b374b33f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:30.897685 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6ec4c908-a2a7-4684-a5c7-724b374b33f4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=80e991e42d904b39bfacf309f33d4a72&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2263944 Nov 15 12:49:30.898560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec4c908-a2a7-4684-a5c7-724b374b33f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b79d080-9b70-474d-a5bd-7cd079825922,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:30.900344 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57308) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:30.950203 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:30.972823 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.024765 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.027632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.028914 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2b79d080-9b70-474d-a5bd-7cd079825922 HTTP/1.1" status: 204 len: 168 time: 0.1275892 Nov 15 12:49:31.038122 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfc2303-ee04-48a6-bce6-3091bbb84fc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b79d080-9b70-474d-a5bd-7cd079825922,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:31.315348 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57324) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:31.328996 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5053b3df-aa3e-4d36-961e-53ac94557f38 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.411638 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5053b3df-aa3e-4d36-961e-53ac94557f38 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.417504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-5053b3df-aa3e-4d36-961e-53ac94557f38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.458839 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-5053b3df-aa3e-4d36-961e-53ac94557f38 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=e85ceaf099b54652a33773e27b3d03c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1423931 Nov 15 12:49:31.460857 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5053b3df-aa3e-4d36-961e-53ac94557f38 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=932a9ca4-9074-4273-9094-e3d35caa2e30,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:31.461669 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57328) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:31.530644 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.554024 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.616431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.618966 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:31.620148 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/932a9ca4-9074-4273-9094-e3d35caa2e30 HTTP/1.1" status: 204 len: 168 time: 0.1571922 Nov 15 12:49:31.628320 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aab314c-9977-40bf-8761-cb3008585f95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=932a9ca4-9074-4273-9094-e3d35caa2e30,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:31.764572 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:49:32.690082 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57366) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:32.822027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6935f43a-8072-46c7-88d5-c0747d9c7afc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:32.900458 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6935f43a-8072-46c7-88d5-c0747d9c7afc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:32.904312 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-6935f43a-8072-46c7-88d5-c0747d9c7afc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:32.944285 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-6935f43a-8072-46c7-88d5-c0747d9c7afc admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=9c154a0898f848b7a64e2759f18c692d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2530355 Nov 15 12:49:32.946840 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57370) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:32.952781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6935f43a-8072-46c7-88d5-c0747d9c7afc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=185d747d-4ea7-4a9f-aece-077613ba7b49,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:32.999365 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.021758 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.068821 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.071402 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.072609 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/185d747d-4ea7-4a9f-aece-077613ba7b49 HTTP/1.1" status: 204 len: 168 time: 0.1248083 Nov 15 12:49:33.080885 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65402d6f-c2d2-48de-b53b-862a35ca2e6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=185d747d-4ea7-4a9f-aece-077613ba7b49,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:33.350882 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-da2fba6d-38fe-4c8d-8690-42cfff24cf79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.755829 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57396) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:33.852198 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-69828109-network', 'tenant_id': '737743b16ec0418fb629805c6e0a1150'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:33.872760 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Made reservation on behalf of 737743b16ec0418fb629805c6e0a1150 for: {'network': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:49:33.874934 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.884207 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.955566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.959501 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.982759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] vlan segment allocate from pool success with {'vlan_id': 617, 'physical_network': 'physnet1'} {{(pid=108287) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:49:33.992792 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c056b79c-3b45-43c0-9c65-79b4a2f4c688,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:33.997377 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:33.997719 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.segments_db [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Added segment 8a8142da-1d36-489e-be0d-5441b680bb36 of type vlan for network 4df1794c-df61-4e22-9f30-ef1b263e82e8 Nov 15 12:49:34.037250 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.061110 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.062042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:34.062633 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.116046 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.3589990 Nov 15 12:49:34.118917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57400) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:34.123899 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Request body: {'subnet': {'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-69828109-subnet', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'ip_version': 4}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:34.126759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f154cc3b-4f2a-4ec6-adef-50a1f6e00451 admin admin] Pushing event updated for resources: {'Network': ['ID=4df1794c-df61-4e22-9f30-ef1b263e82e8,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:34.139871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:49:34.148310 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Made reservation on behalf of 737743b16ec0418fb629805c6e0a1150 for: {'subnet': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:49:34.150608 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30196528'] for subnet, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.314728 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-30644671', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30196514'] for subnet, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.372541 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7f869a7a-ae34-40e6-a819-d5a2784495c3,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:34.381014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Checking segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:34.381372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Network hostable DHCP agents. Network: 4df1794c-df61-4e22-9f30-ef1b263e82e8, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108286) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:49:34.397263 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108286) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:49:34.405477 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, 4df1794c-df61-4e22-9f30-ef1b263e82e8) {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:34.411804 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:34.413097 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.414093 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69f557f2-0037-4a03-9680-77885c4c0d62 None None] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:49:34.429285 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f07adac2-3f31-43f3-853b-d32fff5edf57 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 0.3091743 Nov 15 12:49:34.432148 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57402) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:34.436495 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:34.464904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.465807 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.523736 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.567137 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-4df1794c-df61-4e22-9f30-ef1b263e82e8', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:49:34.568011 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.667106 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.713899 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Allocated IP 172.20.0.2 (4df1794c-df61-4e22-9f30-ef1b263e82e8/7f869a7a-ae34-40e6-a819-d5a2784495c3/1907cda8-e82d-424a-ac3a-fd0ebe632558) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:34.903820 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.903820 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.941895 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.949294 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:34.952237 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:34.959777 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:34.969790 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:34.990454 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Pushing event updated for resources: {'Port': ['ID=1907cda8-e82d-424a-ac3a-fd0ebe632558,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:34.999492 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:34.999843 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.000203 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.000537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.000861 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.001183 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.001501 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.001822 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.002141 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.002456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.003314 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.003725 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:35.046989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Attempting to bind port 1907cda8-e82d-424a-ac3a-fd0ebe632558 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:35.047566 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Attempting to bind port 1907cda8-e82d-424a-ac3a-fd0ebe632558 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:35.048450 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Attempting to bind port 1907cda8-e82d-424a-ac3a-fd0ebe632558 on network 4df1794c-df61-4e22-9f30-ef1b263e82e8 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:35.058551 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:35.059301 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Checking segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:35.060414 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.060761 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Bound using segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:35.061472 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Bound port: 1907cda8-e82d-424a-ac3a-fd0ebe632558, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:35.061910 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.099975 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Allocated IP 172.27.0.74 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/a09cf961-3d95-4d4f-ba34-32e4ee4f826b) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:35.153264 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] For port 1907cda8-e82d-424a-ac3a-fd0ebe632558, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:35.156890 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] For port 1907cda8-e82d-424a-ac3a-fd0ebe632558, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1907cda8-e82d-424a-ac3a-fd0ebe632558,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:35.163393 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.235611 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2228f693-ac77-4a0d-bacd-f3c3199d2adf None None] Pushing event updated for resources: {'Port': ['ID=1907cda8-e82d-424a-ac3a-fd0ebe632558,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:35.270608 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.312504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.362776 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:35.370051 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:35.373566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:35.425516 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Pushing event updated for resources: {'Port': ['ID=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:35.710852 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:35.781792 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-5b3648c3-7a93-4711-8740-6ac4bda7f750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.200993 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4bfa85f-201e-4823-b43b-0169a3270ecc None None] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:49:36.220985 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.270438 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-be17ee1e-5fde-4521-b834-760345472467 None None] Provisioning complete for port 1907cda8-e82d-424a-ac3a-fd0ebe632558 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:36.270801 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-be17ee1e-5fde-4521-b834-760345472467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.371160 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:49:36.445743 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-be17ee1e-5fde-4521-b834-760345472467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.495896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:49:36.500830 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-be17ee1e-5fde-4521-b834-760345472467 None None] For port 1907cda8-e82d-424a-ac3a-fd0ebe632558, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1907cda8-e82d-424a-ac3a-fd0ebe632558,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:36.509839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-be17ee1e-5fde-4521-b834-760345472467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.519614 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Sync routers for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:49:36.533088 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:36.533761 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:36.561161 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.563261 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-82829dce-1710-4f1c-838f-f608259e515f admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 918 time: 2.1298943 Nov 15 12:49:36.566273 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57432) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:36.606020 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be17ee1e-5fde-4521-b834-760345472467 None None] Pushing event updated for resources: {'Port': ['ID=1907cda8-e82d-424a-ac3a-fd0ebe632558,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:36.679128 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:36.857183 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-ffdf2272-6d98-4c96-97da-510a2c0238fb None None] Provisioning complete for port 1907cda8-e82d-424a-ac3a-fd0ebe632558 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:36.858193 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ffdf2272-6d98-4c96-97da-510a2c0238fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.942868 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1907cda8-e82d-424a-ac3a-fd0ebe632558 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:36.973516 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:36.983315 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:35Z', 'revision_number': 3, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:37.019762 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Checking router: b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:49:37.020424 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Updating router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 port a09cf961-3d95-4d4f-ba34-32e4ee4f826b binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:49:37.056537 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 1907cda8-e82d-424a-ac3a-fd0ebe632558 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:37.056797 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.057640 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.119830 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.327547 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Allocated IP 172.20.0.1 (4df1794c-df61-4e22-9f30-ef1b263e82e8/7f869a7a-ae34-40e6-a819-d5a2784495c3/57dd8865-1107-4d65-b9ac-337a02de9bca) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:37.377734 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.383852 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.437836 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Attempting to bind port a09cf961-3d95-4d4f-ba34-32e4ee4f826b on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:37.438110 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Attempting to bind port a09cf961-3d95-4d4f-ba34-32e4ee4f826b by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:37.438475 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Attempting to bind port a09cf961-3d95-4d4f-ba34-32e4ee4f826b on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:37.440612 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Pushing event updated for resources: {'Port': ['ID=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:37.441203 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.449088 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:37.449464 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:37.449869 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.450260 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:37.450996 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Bound port: a09cf961-3d95-4d4f-ba34-32e4ee4f826b, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:37.451136 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.454445 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.454806 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.455164 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.455485 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.455812 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.456152 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.456485 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.456811 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.457320 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.457762 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.457762 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.458099 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108289) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:37.483843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.526260 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] For port a09cf961-3d95-4d4f-ba34-32e4ee4f826b, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:37.530107 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] For port a09cf961-3d95-4d4f-ba34-32e4ee4f826b, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:37.534807 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.550900 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:37.555798 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:37.560472 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:37.563091 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Pushing event updated for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:37.585851 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:37.586954 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:37.607013 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.678418 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0922a0b9-5e81-4ca4-bfaa-ebaeba338f9b None None] Pushing event updated for resources: {'Port': ['ID=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:37.727887 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:37.762746 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.828103 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-a60a6d7c-b81f-4f2c-bc69-b602a3e88c6f None None] Provisioning complete for port 57dd8865-1107-4d65-b9ac-337a02de9bca triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:37.828494 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a60a6d7c-b81f-4f2c-bc69-b602a3e88c6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.863491 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-a60a6d7c-b81f-4f2c-bc69-b602a3e88c6f None None] Port 57dd8865-1107-4d65-b9ac-337a02de9bca cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:49:37.913295 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:35Z', 'revision_number': 3, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:37.929965 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.934356 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:37.944555 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7faa37b8-3e28-4f2a-a3ac-4a8d1256ab44 None None] The sync data for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi is: [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:35Z', 'revision_number': 3, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:49:37.996835 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Pushing event updated for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:38.010005 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:38.105143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:38.106611 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:38.273122 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:49:38.374030 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:38.387729 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-814498ce-861f-409f-90de-a8fd19fe06a0 None None] Provisioning complete for port 57dd8865-1107-4d65-b9ac-337a02de9bca triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:38.388468 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-814498ce-861f-409f-90de-a8fd19fe06a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:38.406153 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:49:38.411709 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-a16a375b-0e65-42fa-ac4d-6e1462872cc0 admin admin] 10.222.0.44 "PUT /v2.0/routers/b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8438730 Nov 15 12:49:38.435183 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-814498ce-861f-409f-90de-a8fd19fe06a0 None None] Port 57dd8865-1107-4d65-b9ac-337a02de9bca cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:49:38.573727 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-777f8933-af4e-43cf-860d-c3ff4054ed75 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-690150005&fields=id&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 267 time: 0.0638826 Nov 15 12:49:38.693010 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-ed963841-2d4b-4f37-b89f-c1c84fafff9f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:38.694971 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-ed963841-2d4b-4f37-b89f-c1c84fafff9f tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.1131399 Nov 15 12:49:38.712068 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-2159fcd3-ebe9-4f0c-b13e-fe2d6bb0f07b tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/quotas/ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 375 time: 0.0101616 Nov 15 12:49:38.774979 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-98c611b6-5819-494a-a462-6fbfd35dc79d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0557098 Nov 15 12:49:38.791825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-a842e305-6e88-433c-9c20-9de2b2e9a099 service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108287) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:49:38.792830 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-a842e305-6e88-433c-9c20-9de2b2e9a099 service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0060213 Nov 15 12:49:38.883353 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device a09cf961-3d95-4d4f-ba34-32e4ee4f826b up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:38.904222 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-b7b7406c-e1d8-41c2-ab87-8c8220ab30f4 service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1009409 Nov 15 12:49:38.951163 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port a09cf961-3d95-4d4f-ba34-32e4ee4f826b triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:38.951590 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:38.985801 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57468) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:38.993657 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-452173356-network', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:39.002760 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-e787f04f-b738-43cd-b26f-e0781c244328 service neutron] 10.222.0.44 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910072 Nov 15 12:49:39.017928 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Made reservation on behalf of 88eeddbaa7bc444a9e28c3f51d3babc5 for: {'network': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:49:39.020354 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for network, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.029573 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.036156 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.058716 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port a09cf961-3d95-4d4f-ba34-32e4ee4f826b, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:39.065904 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.116343 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.119831 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:39.121808 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.153687 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] vlan segment allocate from pool success with {'vlan_id': 644, 'physical_network': 'physnet1'} {{(pid=108286) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 15 12:49:39.161283 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef55c1b6-9fb2-45b3-a513-6e110dba713f,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:39.169353 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.169976 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.segments_db [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Added segment 2c2f3ea3-130b-4d98-8e91-7c36736c18f0 of type vlan for network e02c02f2-7d49-44a7-8377-48dd11f6cf87 Nov 15 12:49:39.177349 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.215375 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738060205815'] for network, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.241728 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264'] for network, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.243026 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:39.243792 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.302966 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] 10.222.0.44 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3145218 Nov 15 12:49:39.305861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57480) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:39.310999 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Request body: {'subnet': {'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-452173356-subnet', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'ip_version': 4}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:39.325334 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f01e243-b5ca-4e77-a2f7-2582c30f68bd admin admin] Pushing event updated for resources: {'Network': ['ID=e02c02f2-7d49-44a7-8377-48dd11f6cf87,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:39.337911 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 details requested by agent ovs-agent-dv-cinder-803823-7-iscsi with host dv-cinder-803823-7-iscsi {{(pid=108288) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 15 12:49:39.343410 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3c55e850-5331-4768-8174-80140bc8b9b1 req-7cc4ea8b-29cd-40b1-84ed-48b1960e6215 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 210 time: 0.0332217 Nov 15 12:49:39.344044 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Made reservation on behalf of 88eeddbaa7bc444a9e28c3f51d3babc5 for: {'subnet': 1} {{(pid=108287) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:49:39.347511 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-30113338'] for subnet, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.540647 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29998907', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-30113320'] for subnet, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.604360 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ad44d629-bfd7-47f4-af4d-983aaf3cd6fb,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:39.613386 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Checking segment: {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108287) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:39.613748 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Network hostable DHCP agents. Network: e02c02f2-7d49-44a7-8377-48dd11f6cf87, hostable agents: ['6a87fe4e-85cf-4774-8d7a-69ba9e5793ba'], hosted agents: [] {{(pid=108287) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 15 12:49:39.632027 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 is scheduled to be hosted by DHCP agent 6a87fe4e-85cf-4774-8d7a-69ba9e5793ba with binding_index 1 {{(pid=108287) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 15 12:49:39.642800 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803823-7-iscsi, e02c02f2-7d49-44a7-8377-48dd11f6cf87) {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:39.649137 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:39.649805 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.654092 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-938c5544-4d1e-46f1-8287-8fb1a60490e6 None None] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:49:39.672098 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-52d5ea1b-4b67-4dd0-a60c-354a827b3497 admin admin] 10.222.0.44 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3624530 Nov 15 12:49:39.672460 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57490) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:39.677504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:39.705637 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-33076537', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-29212'] for router, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.708943 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-33076565', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-33113282', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-448191', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1007'] for router, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.771188 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.810027 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Sync routers for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:49:39.841445 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:39.842066 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:39.925643 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.942392 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpabc26d48-dd15-5c90-8ce1-1d00f2a979ac-e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'fixed_ips': [{'subnet_id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb'}]}} from dv-cinder-803823-7-iscsi. {{(pid=108288) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 15 12:49:39.943289 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:39.991498 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:40.149294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.172310 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.285273 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Allocated IP 172.27.0.244 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/27b0a8d2-823c-4f77-9f4f-55dbe2d10b77) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:40.335731 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.db_base_plugin_common [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Allocated IP 172.20.0.2 (e02c02f2-7d49-44a7-8377-48dd11f6cf87/ad44d629-bfd7-47f4-af4d-983aaf3cd6fb/c118a972-869b-44a3-a205-7bcb7dfe7fc4) {{(pid=108288) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:40.407540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.466098 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.531937 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 2, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:40.544403 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:40.563273 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:40.563475 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Checking router: b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:49:40.563800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Updating router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 port 57dd8865-1107-4d65-b9ac-337a02de9bca binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:49:40.580580 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2e5f31ea-3171-43d7-99ac-667c5ba288f2 req-94ff38d3-b9b6-4977-9b5d-75e7852dbe24 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 210 time: 0.0588396 Nov 15 12:49:40.581650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:40.582423 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-6506195f-de8a-41b0-a4c8-4102bde39ff4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:40.584030 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-6506195f-de8a-41b0-a4c8-4102bde39ff4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 811 time: 0.1479890 Nov 15 12:49:40.591549 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks [] for port, precommit_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.592946 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Pushing event updated for resources: {'Port': ['ID=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:40.600114 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.609197 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022'] for port, after_create {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.673871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 is already hosted by enough agents. {{(pid=108288) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:40.678234 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-23f0df04-b6ac-4788-8e86-702be04bd5c8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ad165f3ffe59498e88611526ef4c254d HTTP/1.1" status: 200 len: 379 time: 0.0761065 Nov 15 12:49:40.683787 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.scheduler.base_scheduler [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Resources bound (agent type, host, resource id): {{(pid=108288) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:40.691719 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Received port after_create {{(pid=108288) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:40.694333 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'port': {'device_id': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'admin_state_up': True, 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'security_groups': ['f5f8a6e7-eff7-4cff-a4f3-64559906341e']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:40.722455 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Pushing event updated for resources: {'Port': ['ID=c118a972-869b-44a3-a205-7bcb7dfe7fc4,revision_number=1']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:40.813900 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Attempting to bind port c118a972-869b-44a3-a205-7bcb7dfe7fc4 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:40.814278 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Attempting to bind port c118a972-869b-44a3-a205-7bcb7dfe7fc4 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:40.814640 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Attempting to bind port c118a972-869b-44a3-a205-7bcb7dfe7fc4 on network e02c02f2-7d49-44a7-8377-48dd11f6cf87 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:40.824523 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:40.825193 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Checking segment: {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:40.825323 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.825660 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Bound using segment: {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:40.826127 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Bound port: c118a972-869b-44a3-a205-7bcb7dfe7fc4, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:40.826504 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.832664 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Made reservation on behalf of ad165f3ffe59498e88611526ef4c254d for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:49:40.838413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.884709 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:40.906449 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device a09cf961-3d95-4d4f-ba34-32e4ee4f826b up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:40.993218 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.20.0.7 (7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f/2a6efff2-9e7d-4592-b2fe-44911cde042e/26bc9e42-8935-44bf-a2f2-37fddbc837c3) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:40.995364 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] For port c118a972-869b-44a3-a205-7bcb7dfe7fc4, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:41.019613 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] For port c118a972-869b-44a3-a205-7bcb7dfe7fc4, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c118a972-869b-44a3-a205-7bcb7dfe7fc4,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:41.030731 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.074403 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port a09cf961-3d95-4d4f-ba34-32e4ee4f826b triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:41.074679 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.104592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-33076556', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-33113117'] for router, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.173673 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.186846 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.188544 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e39cf7-e790-4fde-b10d-290b53bb96f3 None None] Pushing event updated for resources: {'Port': ['ID=c118a972-869b-44a3-a205-7bcb7dfe7fc4,revision_number=2']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:41.208978 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.230666 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.292277 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:41.306472 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:41.316248 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:41.316438 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdff041-95c6-4c32-8805-f6f575134c9a None None] Pushing event updated for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:41.346686 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Router b4807293-44a0-4ef8-acbc-ef880e57fb07 is scheduled to L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 with binding_index 1 {{(pid=108287) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 15 12:49:41.360712 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:41.393923 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Attempting to bind port 57dd8865-1107-4d65-b9ac-337a02de9bca on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:41.394271 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Attempting to bind port 57dd8865-1107-4d65-b9ac-337a02de9bca by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:41.394627 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Attempting to bind port 57dd8865-1107-4d65-b9ac-337a02de9bca on network 4df1794c-df61-4e22-9f30-ef1b263e82e8 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:41.398536 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:41.398985 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.412663 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:41.413195 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Checking segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:41.413889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.414497 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Bound using segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:41.415196 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Bound port: 57dd8865-1107-4d65-b9ac-337a02de9bca, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:41.415795 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.433341 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-f9521ad7-7eb1-47ca-bb1e-78f27d1add3c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7486579 Nov 15 12:49:41.457919 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Request body: {'port': {'device_id': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:41.530447 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:49:41.537497 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] For port 57dd8865-1107-4d65-b9ac-337a02de9bca, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:41.541133 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] For port 57dd8865-1107-4d65-b9ac-337a02de9bca, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=57dd8865-1107-4d65-b9ac-337a02de9bca,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:41.543230 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Sync routers for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:49:41.554950 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.557207 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.559417 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:41.562934 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:41.563814 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4079378b-b916-4bc4-a7d6-592c243fdd0c admin admin] 10.222.0.44 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.8902631 Nov 15 12:49:41.568215 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57496) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:41.571745 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.681505 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:41.682134 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:41.768370 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:41.918694 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdff041-95c6-4c32-8805-f6f575134c9a None None] Pushing event updated for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:41.962272 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] Provisioning complete for port 57dd8865-1107-4d65-b9ac-337a02de9bca triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:41.962929 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.967971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 26bc9e42-8935-44bf-a2f2-37fddbc837c3 {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:49:41.979104 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:41.997036 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:40Z', 'revision_number': 3, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:42.014891 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666056d9-070e-45a1-b430-f4f03bbd6689 req-c5dbd0c2-3db4-48c2-ad7b-c7e3bfbca069 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:42.016550 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666056d9-070e-45a1-b430-f4f03bbd6689 req-c5dbd0c2-3db4-48c2-ad7b-c7e3bfbca069 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 931 time: 0.3107059 Nov 15 12:49:42.026077 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Transition to ACTIVE for port object 26bc9e42-8935-44bf-a2f2-37fddbc837c3 will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:49:42.047651 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Checking router: b4807293-44a0-4ef8-acbc-ef880e57fb07 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:49:42.048264 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Updating router b4807293-44a0-4ef8-acbc-ef880e57fb07 port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 binding host dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:49:42.058475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.074261 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:42.097188 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.135854 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666056d9-070e-45a1-b430-f4f03bbd6689 req-68e72aff-d5be-4b5b-bbd9-d3d966f119d5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1080728 Nov 15 12:49:42.239046 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Pushing event updated for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:42.294777 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Attempting to bind port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:42.295414 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Attempting to bind port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:42.295917 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Attempting to bind port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:42.301361 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:49:42.301956 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Attempting to bind port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 on network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:42.307939 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:42.308537 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Checking segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:42.309102 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Bound using segment: {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:42.309854 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Bound port: 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10a7f5a3-60bf-4073-9982-3736ed07544b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:42.310491 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.411424 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:42.422280 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:42.429075 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.492636 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:42.493286 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.494699 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] 10.222.0.61 "PUT /v2.0/ports/26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 1093 time: 1.0412071 Nov 15 12:49:42.495575 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:49:42.497503 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38a24878-d45b-47d1-9b4e-7a741e328163" -d '{"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:49:42.567931 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3daf5b-f320-4176-8e1e-3c4329a62eef service neutron] Pushing event updated for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:42.599587 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.609733 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks [] for port, precommit_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.623473 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.669343 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:49:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6db4fba6-a71f-439d-9f4a-e4cea44d7fb7 x-openstack-request-id: req-6db4fba6-a71f-439d-9f4a-e4cea44d7fb7 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:49:42.669641 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:49:42.669890 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6db4fba6-a71f-439d-9f4a-e4cea44d7fb7 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:49:42.670756 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] For port 57dd8865-1107-4d65-b9ac-337a02de9bca, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=57dd8865-1107-4d65-b9ac-337a02de9bca,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:42.672034 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'status': 'completed', 'code': 200} Nov 15 12:49:42.678254 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0d6869d-b4d2-4fcd-8527-154e54df30d2 None None] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:49:42.686763 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a75e66-25d4-4a70-ab54-2f7f3681b8ee None None] Pushing event updated for resources: {'Port': ['ID=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,revision_number=2']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:42.710455 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-425e8783-b9f2-4a98-9f59-c24893a1e2bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:42.712281 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-425e8783-b9f2-4a98-9f59-c24893a1e2bb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1096 time: 0.1209896 Nov 15 12:49:42.720684 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Attempting to bind port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:42.720890 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Attempting to bind port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:42.721239 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Attempting to bind port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 on network 45831433-abc0-4e27-bccd-5aeb94543032 {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:42.727414 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:42.727783 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Checking segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108289) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:42.728205 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.728595 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Bound using segment: {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'} {{(pid=108289) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:42.729324 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.managers [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Bound port: 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf382968-1d0a-45d6-a42c-25204c795036', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032'}}] {{(pid=108289) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:42.729720 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.736559 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.816222 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] For port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108289) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:42.820794 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.plugins.ml2.db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] For port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108289) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:42.829694 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron_lib.callbacks.manager [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108289) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.854774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:42.875989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e750a2eb-0c63-4b6c-b46a-24ed4b8191b2 None None] Pushing event updated for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:42.898797 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-7c58077f-10d6-478b-8c41-7e11c81b67a8 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 217 time: 0.1443231 Nov 15 12:49:42.987879 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-8048f2b4-686e-4214-9772-77e84ef0bdfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:42.990413 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-8048f2b4-686e-4214-9772-77e84ef0bdfb service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0882449 Nov 15 12:49:43.023371 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c118a972-869b-44a3-a205-7bcb7dfe7fc4 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:43.055226 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-87b724ea-7345-444a-8306-da17470eb933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:43.057666 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-87b724ea-7345-444a-8306-da17470eb933 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0582728 Nov 15 12:49:43.074001 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a75e66-25d4-4a70-ab54-2f7f3681b8ee None None] Pushing event updated for resources: {'Port': ['ID=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,revision_number=3']} {{(pid=108289) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:43.078702 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:43.079453 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:43.098720 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Allocated IP 172.20.0.1 (e02c02f2-7d49-44a7-8377-48dd11f6cf87/ad44d629-bfd7-47f4-af4d-983aaf3cd6fb/2cab7388-9f52-48c2-9fc7-0e83712e1295) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:43.113988 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Provisioning complete for port c118a972-869b-44a3-a205-7bcb7dfe7fc4 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:43.114613 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.159454 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:41Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:43.231191 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-5cf982d3-308a-4124-a935-ce27e4d65f63 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1614153 Nov 15 12:49:43.247938 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:43.268984 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991fac88-f688-4395-9098-aa347ec12db7 None None] The sync data for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi is: [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:41Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:49:43.269430 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.330276 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.388085 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.391063 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port c118a972-869b-44a3-a205-7bcb7dfe7fc4 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:43.391063 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.437680 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:43.445697 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac6cf44-5cb6-4a00-b1ee-680e8b2baf11 req-981f3842-4425-47d1-85c8-c2657952df92 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:43.448902 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] For port c118a972-869b-44a3-a205-7bcb7dfe7fc4, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c118a972-869b-44a3-a205-7bcb7dfe7fc4,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:43.453861 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8ac6cf44-5cb6-4a00-b1ee-680e8b2baf11 req-981f3842-4425-47d1-85c8-c2657952df92 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.2214668 Nov 15 12:49:43.463571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.496308 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:43.504622 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Pushing event updated for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:43.507668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:43.535905 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Provisioning complete for port 57dd8865-1107-4d65-b9ac-337a02de9bca triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:43.536624 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.586486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-33077954'] for router_interface, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.589467 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-8ac6cf44-5cb6-4a00-b1ee-680e8b2baf11 req-9e51d5e3-27a8-45ae-8d65-f73eb0586070 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1343079 Nov 15 12:49:43.594103 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a6ecb2db-731b-4fbd-a013-9159f87b4c85 req-89157296-dbd0-479f-916f-7afe73990db5 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3488767 Nov 15 12:49:43.673095 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:40Z', 'revision_number': 3, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:43.696266 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03859ca4-839b-47c4-a912-822396c5daeb None None] Pushing event updated for resources: {'Port': ['ID=c118a972-869b-44a3-a205-7bcb7dfe7fc4,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:43.727720 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521c2f4-bcec-486b-a6d8-c15d3d51a7c5 None None] The sync data for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi is: [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:40Z', 'revision_number': 3, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:49:43.780819 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-0f6db206-d101-4b6a-b028-08f356c3ab85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:43.784963 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-0f6db206-d101-4b6a-b028-08f356c3ab85 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1096 time: 0.0794473 Nov 15 12:49:43.842935 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:43.972416 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-a6840ada-f4e6-4185-8b37-c34f5727c162 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:43.974393 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-a6840ada-f4e6-4185-8b37-c34f5727c162 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.1783035 Nov 15 12:49:43.993599 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-67e5d428-ac97-41d4-8a58-afb83224cc53 None None] Provisioning complete for port c118a972-869b-44a3-a205-7bcb7dfe7fc4 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:43.993959 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-67e5d428-ac97-41d4-8a58-afb83224cc53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.053162 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-6d7e9a56-6417-4a5d-881a-5c54d7168fd6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 217 time: 0.0686812 Nov 15 12:49:44.149281 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.169789 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-30d69172-33a9-4670-a524-02365175c73d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:44.171324 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-30d69172-33a9-4670-a524-02365175c73d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.1082859 Nov 15 12:49:44.224480 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.229202 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.293726 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-36f93430-7b3d-45e5-b0e6-e1c76bc068ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:44.295326 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-36f93430-7b3d-45e5-b0e6-e1c76bc068ba service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0844223 Nov 15 12:49:44.318167 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Pushing event updated for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:44.338708 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-33035314', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-33077854'] for router_interface, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.355711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-7b040f58-2f23-43e7-83c4-c79edb4a1f78 None None] Provisioning complete for port 2cab7388-9f52-48c2-9fc7-0e83712e1295 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:44.356053 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7b040f58-2f23-43e7-83c4-c79edb4a1f78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.411862 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-9b989821-7d43-4df0-8983-cd9a7adf9452 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1058671 Nov 15 12:49:44.425860 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-7b040f58-2f23-43e7-83c4-c79edb4a1f78 None None] Port 2cab7388-9f52-48c2-9fc7-0e83712e1295 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:49:44.465170 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:44.466589 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:44.557854 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-38a24878-d45b-47d1-9b4e-7a741e328163 req-186294a6-5941-4313-80bd-0c5af8adfb2f service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310747 Nov 15 12:49:44.627498 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Router b4807293-44a0-4ef8-acbc-ef880e57fb07 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:49:44.749440 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-1203b975-9cca-413f-abf8-9c8c63ed7c94 None None] Provisioning complete for port 2cab7388-9f52-48c2-9fc7-0e83712e1295 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:44.749819 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1203b975-9cca-413f-abf8-9c8c63ed7c94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:44.796136 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-1203b975-9cca-413f-abf8-9c8c63ed7c94 None None] Port 2cab7388-9f52-48c2-9fc7-0e83712e1295 cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:49:44.802947 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd26e01-2450-493c-a926-7a310c25f8c4 req-550b4106-3249-4435-9e2e-a931c319cdae tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:44.811231 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0fd26e01-2450-493c-a926-7a310c25f8c4 req-550b4106-3249-4435-9e2e-a931c319cdae tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.1188557 Nov 15 12:49:44.839723 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:49:44.847870 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-85871c42-1d3d-45b3-8978-e633c98c80a4 admin admin] 10.222.0.44 "PUT /v2.0/routers/b4807293-44a0-4ef8-acbc-ef880e57fb07/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2784469 Nov 15 12:49:44.888587 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0fd26e01-2450-493c-a926-7a310c25f8c4 req-c66ac488-1113-4fb2-b6ff-d75e2156a005 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0762861 Nov 15 12:49:45.043942 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 57dd8865-1107-4d65-b9ac-337a02de9bca up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:45.148754 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 57dd8865-1107-4d65-b9ac-337a02de9bca triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:45.149467 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.262013 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:45.332032 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:45.332694 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.420081 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.449629 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] For port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:45.454020 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.454861 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c118a972-869b-44a3-a205-7bcb7dfe7fc4 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:45.550265 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Pushing event updated for resources: {'Port': ['ID=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:45.558398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port c118a972-869b-44a3-a205-7bcb7dfe7fc4 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:45.559058 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.639966 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57530) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:45.644803 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-548365070', 'description': 'tempest-secgroup-smoke-548365070 description', 'project_id': '737743b16ec0418fb629805c6e0a1150'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:45.682667 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.784174 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.788896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.830940 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3597f45e-b04d-41cd-a10a-420b69e29085,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:45.838007 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.839299 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f0779aa9-88eb-43de-a5a8-e09eccf31c78 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1982970 Nov 15 12:49:45.844169 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57536) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:45.850100 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:45.885825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.960389 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.965603 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:45.994834 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fb9abf61-8444-472e-8bed-266cbecb0539,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.013466 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.015774 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-411d3650-f2b5-4ac7-9e57-6a256918d5f2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1702704 Nov 15 12:49:46.019366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57542) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:46.026921 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:46.066008 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.086607 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9af8cf-38f8-40d9-8291-620989483294 req-adba4ae1-c858-4c03-b782-0dd79ce67e20 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:46.088579 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-af9af8cf-38f8-40d9-8291-620989483294 req-adba4ae1-c858-4c03-b782-0dd79ce67e20 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.0635126 Nov 15 12:49:46.156026 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.156293 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-af9af8cf-38f8-40d9-8291-620989483294 req-f5560e14-e854-4a94-8556-27461cf525a9 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592363 Nov 15 12:49:46.162023 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.181729 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=90e874ac-b3ec-4b70-bb43-c2e751bacae0,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.196840 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.198126 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4d427c6b-dfb9-4320-9f08-bcf68f0dc860 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1772838 Nov 15 12:49:46.200945 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57544) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:46.205954 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:46.247342 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.302414 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Sync routers for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:49:46.313756 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:46.314391 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:46.319198 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.324083 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.353192 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5bf52cc9-9aa0-41d3-8155-4e435521b94b,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.360772 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.366344 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57546) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:46.368341 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-727370d6-d78c-4e57-ba41-ea4764da125a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1597719 Nov 15 12:49:46.372825 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:46.403006 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.452398 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:46.474271 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.479232 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.498982 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=427817ab-6f56-44f7-a654-3a742b8ae4a8,revision_number=0']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.520822 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.522138 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-3bf43fd9-dfc1-40cd-9387-6ae6ecab2cf6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1541564 Nov 15 12:49:46.526011 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57548) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:46.531132 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:46.557083 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.securitygroups_db [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Project 737743b16ec0418fb629805c6e0a1150 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:49:46.562935 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.628365 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.632550 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.654415 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6fb569e4-e884-4bfd-84ff-2593bec2325f,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.666266 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.667973 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-4e41ae04-79f2-4175-8352-48f38073c461 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1407673 Nov 15 12:49:46.671363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57550) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:46.677271 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'security_group_rule': {'security_group_id': '3597f45e-b04d-41cd-a10a-420b69e29085', 'project_id': '737743b16ec0418fb629805c6e0a1150', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:46.703404 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.securitygroups_db [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Project 737743b16ec0418fb629805c6e0a1150 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 15 12:49:46.712354 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.712944 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:43Z', 'revision_number': 4, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '2cab7388-9f52-48c2-9fc7-0e83712e1295', 'name': '', 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'mac_address': 'fa:16:3e:1d:97:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_interface', 'standard_attr_id': 658, 'fixed_ips': [{'subnet_id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:42Z', 'updated_at': '2021-11-15T12:49:43Z', 'revision_number': 2, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'subnets': [{'id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:46.740964 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Checking router: b4807293-44a0-4ef8-acbc-ef880e57fb07 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:49:46.741310 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Updating router b4807293-44a0-4ef8-acbc-ef880e57fb07 port 2cab7388-9f52-48c2-9fc7-0e83712e1295 binding host dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 15 12:49:46.766783 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.779760 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.784732 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091880'] for security_group_rule, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.818240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f29eb76d-9a8a-4459-b0aa-62de2bdaa1e1,revision_number=0']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:46.824680 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:46.826355 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-3cede7bd-2812-4c3e-8d6e-60f22e6d31d8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1538291 Nov 15 12:49:46.876828 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:47.002087 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:47.002457 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.175935 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks [] for port, precommit_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.187817 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.345744 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d78adf-ec24-40d1-b639-2d6fb27fed23 None None] Pushing event updated for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=3']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:47.479368 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Attempting to bind port 2cab7388-9f52-48c2-9fc7-0e83712e1295 on host dv-cinder-803823-7-iscsi for vnic_type normal with profile {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:49:47.479931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Attempting to bind port 2cab7388-9f52-48c2-9fc7-0e83712e1295 by drivers openvswitch,hyperv on host dv-cinder-803823-7-iscsi at level 0 using segments [{'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:49:47.480521 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Attempting to bind port 2cab7388-9f52-48c2-9fc7-0e83712e1295 on network e02c02f2-7d49-44a7-8377-48dd11f6cf87 {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:49:47.482323 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed8473c-dcf6-42b7-93a0-b33922d527bf req-d2475ca6-239a-4095-b8aa-845310b8d0f1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:47.486062 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aed8473c-dcf6-42b7-93a0-b33922d527bf req-d2475ca6-239a-4095-b8aa-845310b8d0f1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.1697192 Nov 15 12:49:47.490100 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Checking agent: {'id': '3eda948e-a8d6-4f40-8daf-0774751b4b9d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803823-7-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 31, 39), 'started_at': datetime.datetime(2021, 11, 15, 12, 32, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803823-7-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:49:47.490652 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Checking segment: {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108288) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:49:47.491228 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.491873 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Bound using segment: {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'} {{(pid=108288) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:49:47.492821 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.managers [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Bound port: 2cab7388-9f52-48c2-9fc7-0e83712e1295, host: dv-cinder-803823-7-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c2f3ea3-130b-4d98-8e91-7c36736c18f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87'}}] {{(pid=108288) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:49:47.493618 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.562423 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aed8473c-dcf6-42b7-93a0-b33922d527bf req-621eac62-25d3-42cb-9a7d-3f9d7cc6cde8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0674119 Nov 15 12:49:47.594404 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] For port 2cab7388-9f52-48c2-9fc7-0e83712e1295, host dv-cinder-803823-7-iscsi, cleared binding levels {{(pid=108288) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:49:47.599741 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] For port 2cab7388-9f52-48c2-9fc7-0e83712e1295, host dv-cinder-803823-7-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=2cab7388-9f52-48c2-9fc7-0e83712e1295,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108288) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:49:47.605583 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.805335 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] Provisioning complete for port 2cab7388-9f52-48c2-9fc7-0e83712e1295 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:47.806023 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:47.830262 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d78adf-ec24-40d1-b639-2d6fb27fed23 None None] Pushing event updated for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:47.833214 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:47.833817 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:47.995571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:48.030560 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:48.142823 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] For port 2cab7388-9f52-48c2-9fc7-0e83712e1295, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=2cab7388-9f52-48c2-9fc7-0e83712e1295,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:48.147729 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:48.222530 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e3bea4-6c09-4db2-9160-ab9b6fd134c1 None None] Pushing event updated for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:48.288675 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0a6c4a69-6190-46f1-b70a-2698d5581a0a None None] Provisioning complete for port 2cab7388-9f52-48c2-9fc7-0e83712e1295 triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:48.289018 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0a6c4a69-6190-46f1-b70a-2698d5581a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:48.321825 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:43Z', 'revision_number': 4, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '2cab7388-9f52-48c2-9fc7-0e83712e1295', 'name': '', 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'mac_address': 'fa:16:3e:1d:97:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_interface', 'standard_attr_id': 658, 'fixed_ips': [{'subnet_id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:42Z', 'updated_at': '2021-11-15T12:49:47Z', 'revision_number': 4, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'subnets': [{'id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:48.355039 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b86b1eb-1ce6-4ce9-a80e-bcf910efaf8b None None] The sync data for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi is: [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:49:43Z', 'revision_number': 4, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '2cab7388-9f52-48c2-9fc7-0e83712e1295', 'name': '', 'network_id': 'e02c02f2-7d49-44a7-8377-48dd11f6cf87', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'mac_address': 'fa:16:3e:1d:97:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_interface', 'standard_attr_id': 658, 'fixed_ips': [{'subnet_id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:42Z', 'updated_at': '2021-11-15T12:49:47Z', 'revision_number': 4, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'subnets': [{'id': 'ad44d629-bfd7-47f4-af4d-983aaf3cd6fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:49:48.694926 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b64dedf-6bae-430f-a5d2-30ba82edf832 req-2e26619b-598b-4012-bd05-276293ea5db5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:48.696551 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3b64dedf-6bae-430f-a5d2-30ba82edf832 req-2e26619b-598b-4012-bd05-276293ea5db5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.0581744 Nov 15 12:49:48.769016 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-3b64dedf-6bae-430f-a5d2-30ba82edf832 req-4c93d1a7-3126-46b2-9b52-3a170d921098 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0657930 Nov 15 12:49:48.902668 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 2cab7388-9f52-48c2-9fc7-0e83712e1295 up at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:48.970163 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Provisioning complete for port 2cab7388-9f52-48c2-9fc7-0e83712e1295 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:48.970527 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:49.426171 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25609a2-6a59-40d9-bdbb-7744b26bc531 req-4fb6e720-044f-4b50-8ede-1b9acf9fb937 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.428037 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d25609a2-6a59-40d9-bdbb-7744b26bc531 req-4fb6e720-044f-4b50-8ede-1b9acf9fb937 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0569088 Nov 15 12:49:49.451430 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-a7fd6d13-1a01-4c97-9c85-d8c4256d894f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0473838 Nov 15 12:49:49.497681 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d25609a2-6a59-40d9-bdbb-7744b26bc531 req-7232727d-b72d-4398-b361-b1dfba66afe2 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614395 Nov 15 12:49:49.570481 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-198bb0ae-1df7-47bc-a68a-d5695b138073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.571982 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-198bb0ae-1df7-47bc-a68a-d5695b138073 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1098 time: 0.0567040 Nov 15 12:49:49.689417 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-16f613a3-aade-4cb6-bede-7a1db72f6ba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.691702 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-16f613a3-aade-4cb6-bede-7a1db72f6ba8 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.0961101 Nov 15 12:49:49.786076 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-efe2aa85-a001-4a9f-9aad-1b824cbe998d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 1001 time: 0.0856581 Nov 15 12:49:49.840276 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-53bea447-5333-46bb-b454-43d8fe59951d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.841981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-53bea447-5333-46bb-b454-43d8fe59951d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0483637 Nov 15 12:49:49.932538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-fa0e36bd-faca-4031-a497-69bc8fbf6e92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.934101 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-fa0e36bd-faca-4031-a497-69bc8fbf6e92 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0815699 Nov 15 12:49:49.951755 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa61c65a-3433-4518-9b21-84cbb1bd70d3 req-1e9c8fbe-da00-4dd8-afc8-aebfe29b074d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:49.953716 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aa61c65a-3433-4518-9b21-84cbb1bd70d3 req-1e9c8fbe-da00-4dd8-afc8-aebfe29b074d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.0892897 Nov 15 12:49:50.079829 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-aa61c65a-3433-4518-9b21-84cbb1bd70d3 req-da083294-5af1-47c2-8436-ac98cb84d890 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1138370 Nov 15 12:49:50.100348 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-49d51746-fbb7-490f-8be7-eccec53d8d7d service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1408496 Nov 15 12:49:50.193938 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-777af688-2557-4313-9d62-2ce69cb1e6f9 req-135e4893-2839-41e1-97f5-3f6719e6671f service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887315 Nov 15 12:49:50.645128 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c4fb3c-853f-46c6-b074-cd4a5fa8995b req-ead74019-cecd-4c9b-92ec-11d16bc94013 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:50.646630 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a4c4fb3c-853f-46c6-b074-cd4a5fa8995b req-ead74019-cecd-4c9b-92ec-11d16bc94013 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0642323 Nov 15 12:49:50.711530 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a4c4fb3c-853f-46c6-b074-cd4a5fa8995b req-c09a9116-02a6-4621-9d32-8f7d9647a077 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547214 Nov 15 12:49:51.222422 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dfb259-5560-4f9c-856b-16d269fb24f0 req-39a806ec-17fc-4073-b714-ca2dc6734972 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:51.225094 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2dfb259-5560-4f9c-856b-16d269fb24f0 req-39a806ec-17fc-4073-b714-ca2dc6734972 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.0661025 Nov 15 12:49:51.295329 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-e2dfb259-5560-4f9c-856b-16d269fb24f0 req-67c6735e-449a-4b41-83f9-042cc7849232 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0640473 Nov 15 12:49:51.834577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-bcaeafcc-4b47-4382-b0e7-53d97ea3b158 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:51.836056 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-bcaeafcc-4b47-4382-b0e7-53d97ea3b158 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0503676 Nov 15 12:49:51.847050 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2185ca8-0e9e-4890-90d0-364a1b7ce571 req-c3c19420-206b-4fe6-b117-c7df76b67599 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:51.849786 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d2185ca8-0e9e-4890-90d0-364a1b7ce571 req-c3c19420-206b-4fe6-b117-c7df76b67599 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 946 time: 0.0584471 Nov 15 12:49:51.914735 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d2185ca8-0e9e-4890-90d0-364a1b7ce571 req-961fc6c3-1c15-4ed5-b43a-b7caa3bb4037 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups?id=57590bd3-033b-4647-baa1-b4695e0b4f51&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564601 Nov 15 12:49:51.942351 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Deleting port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:49:51.942989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:52.036051 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] For port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:52.036438 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:52.527797 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9724a37-90c6-42a5-a15b-5d2007adecfa req-f9bd798c-9c5c-4d36-85e4-9ad455149e84 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:52.529472 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f9724a37-90c6-42a5-a15b-5d2007adecfa req-f9bd798c-9c5c-4d36-85e4-9ad455149e84 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.1175265 Nov 15 12:49:52.541207 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:52.541565 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:52.542146 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Floating IP 4983bfb5-1d0b-4f56-8007-41de688cb38a disassociated. External IP: 172.27.0.28, port: efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33. Nov 15 12:49:52.542486 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Calling delete_port for efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:49:52.640562 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f9724a37-90c6-42a5-a15b-5d2007adecfa req-82e0a5bd-ff6a-4d0a-a00f-5290c7be1e9d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1028216 Nov 15 12:49:52.749035 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:52.781754 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'Port': ['ID=efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:52.907682 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:49:53.029680 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eeb8be91-c7c4-445d-b718-13396e065658 req-36eb611e-0e00-4d6d-b360-78b608a39d26 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/ports?device_id=f6d5a9b8-14f1-401b-a77e-971d89b389ce HTTP/1.1" status: 200 len: 210 time: 0.0306671 Nov 15 12:49:53.039801 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:49:53.052587 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:49:53.067194 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:53.068070 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:53.083513 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] No DVR routers for this DVR port efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:49:53.086310 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:53.090047 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9b43ecac-f5b3-4d46-a021-7cdad4daa64b req-a5236ec0-5678-4b53-b8d0-f66070789011 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.61 "DELETE /v2.0/ports/efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 HTTP/1.1" status: 204 len: 173 time: 1.2474179 Nov 15 12:49:53.090642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'name': 'network-vif-deleted', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:49:53.093971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e8a39d6-7bff-4b33-bf64-31edb84aac44" -d '{"events": [{"server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "name": "network-vif-deleted", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:49:53.142493 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:49:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fdbe7c54-b73d-4db6-a13e-53e48e354d79 x-openstack-request-id: req-fdbe7c54-b73d-4db6-a13e-53e48e354d79 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:49:53.143307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f6d5a9b8-14f1-401b-a77e-971d89b389ce", "name": "network-vif-deleted", "tag": "efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:49:53.143774 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-fdbe7c54-b73d-4db6-a13e-53e48e354d79 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:49:53.144425 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6d5a9b8-14f1-401b-a77e-971d89b389ce', 'name': 'network-vif-deleted', 'tag': 'efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33', 'status': 'completed', 'code': 200} Nov 15 12:49:53.224475 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:53.470627 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:53.500927 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:49:53.510086 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:49:53.510682 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:53.631134 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:49:53.796292 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd69b30-3ddf-4adb-85c5-604da9317672 req-1e875eb8-7267-495c-8f45-c9fcf0f46ff9 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:53.798129 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6dd69b30-3ddf-4adb-85c5-604da9317672 req-1e875eb8-7267-495c-8f45-c9fcf0f46ff9 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 943 time: 0.0846388 Nov 15 12:49:53.864474 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-6dd69b30-3ddf-4adb-85c5-604da9317672 req-3ff08ab6-a75e-4411-80a8-a5b961fe047c tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0589435 Nov 15 12:49:53.898784 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:49:53.927362 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d55c4de5-9c39-4cb6-8377-9bd722b0de5d None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:07Z', 'revision_number': 4, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '65376b5d-20e9-4d73-898c-67d942f03649', 'name': '', 'network_id': 'd674a754-ca11-4d5c-be9e-426d0c193bcb', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'mac_address': 'fa:16:3e:48:de:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_interface', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '925098dd-312e-4533-8590-2a9da45326c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:05Z', 'updated_at': '2021-11-15T12:45:11Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'subnets': [{'id': '925098dd-312e-4533-8590-2a9da45326c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:49:54.125120 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57676) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:54.183757 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.207714 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.257668 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.260228 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.261394 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "DELETE /v2.0/security-groups/57590bd3-033b-4647-baa1-b4695e0b4f51 HTTP/1.1" status: 204 len: 168 time: 0.1352715 Nov 15 12:49:54.264285 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57678) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:54.271170 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=57590bd3-033b-4647-baa1-b4695e0b4f51,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:54.278061 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.api.v2.resource [None req-908324d5-8175-4212-8f2a-308231c2422b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] show failed (client error): The resource could not be found. Nov 15 12:49:54.278248 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.278592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.278925 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.279033 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-908324d5-8175-4212-8f2a-308231c2422b tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "GET /v2.0/security-groups/57590bd3-033b-4647-baa1-b4695e0b4f51 HTTP/1.1" status: 404 len: 347 time: 0.0137746 Nov 15 12:49:54.279252 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.279576 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.279896 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.280309 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.280634 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.280953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.281270 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.281584 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.281905 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a8fa1b8-a727-4f2b-9ced-a628c34a1875 tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:49:54.282008 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57680) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:54.313748 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 26bc9e42-8935-44bf-a2f2-37fddbc837c3 details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:49:54.324858 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:49:54.359419 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:49:54.359751 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device efb6cb1b-f14a-4217-a9d4-a3c5ebf88b33 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:49:54.424864 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Deleting port 74612d34-2462-406a-aac6-227b6172af6c {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:49:54.425339 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.448692 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:54.468179 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'port_id': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'mac_address': 'fa:16:3e:12:0c:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 636, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:49:54.516269 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.518991 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.519730 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.531703 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 26bc9e42-8935-44bf-a2f2-37fddbc837c3 {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:49:54.532467 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Calling delete_port for 74612d34-2462-406a-aac6-227b6172af6c owned by network:floatingip {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:49:54.552903 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:54.557505 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.609621 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:54.698129 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.726151 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Pushing event deleted for resources: {'Port': ['ID=74612d34-2462-406a-aac6-227b6172af6c,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:54.792097 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks [] for floatingip, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.794847 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:54.796469 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d02f0214-1e48-4bbe-92b4-488d49829c1c tempest-AttachVolumeTestJSON-1266468861 tempest-AttachVolumeTestJSON-1266468861-project] 10.222.0.44 "DELETE /v2.0/floatingips/4983bfb5-1d0b-4f56-8007-41de688cb38a HTTP/1.1" status: 204 len: 168 time: 0.5130394 Nov 15 12:49:54.926855 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['26bc9e42-8935-44bf-a2f2-37fddbc837c3'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:49:55.032624 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a4e8f3-e9ea-40b1-85ed-3fcf571ece61 req-a53d55dc-a5cf-4477-afa2-2d0274da9572 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:55.035024 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9a4e8f3-e9ea-40b1-85ed-3fcf571ece61 req-a53d55dc-a5cf-4477-afa2-2d0274da9572 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 944 time: 0.0563748 Nov 15 12:49:55.125867 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c9a4e8f3-e9ea-40b1-85ed-3fcf571ece61 req-3e524c37-4879-4a09-8820-6f664eac8fc4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0820639 Nov 15 12:49:55.197719 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d52c53d7-3c38-4663-9c88-6cfdd9e571a1 None None] New status for floating IP 4983bfb5-1d0b-4f56-8007-41de688cb38a: DOWN {{(pid=108288) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:49:56.247716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45949814-8abb-4ead-ba54-4d603525acf8 req-4d707bf9-b426-4b87-9557-0ce267e39239 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:56.249356 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-45949814-8abb-4ead-ba54-4d603525acf8 req-4d707bf9-b426-4b87-9557-0ce267e39239 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 944 time: 0.0539794 Nov 15 12:49:56.298664 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-45949814-8abb-4ead-ba54-4d603525acf8 req-e73b0dcc-e167-4f70-946e-ca0a67e90a5e tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426481 Nov 15 12:49:56.345474 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 26bc9e42-8935-44bf-a2f2-37fddbc837c3 up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:49:56.395708 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:49:56.400048 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:49:56.400449 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:56.481541 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:56.505020 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:49:56.507711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a50bea73-daf7-4588-bd9e-35f6ae0cb04a" -d '{"events": [{"server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "name": "network-vif-plugged", "status": "completed", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:49:56.521388 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:56.525778 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:56.556740 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:49:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9809cd04-007e-4330-906d-c413ec92af49 x-openstack-request-id: req-9809cd04-007e-4330-906d-c413ec92af49 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:49:56.557032 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "name": "network-vif-plugged", "status": "completed", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:49:56.557499 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-9809cd04-007e-4330-906d-c413ec92af49 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:49:56.557895 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'code': 200} Nov 15 12:49:56.581677 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:56.772738 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d467c7a-ee45-4091-9fd6-8c467d189cf0 req-3337a25f-8141-4875-8001-dee52a4aa4a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:56.774241 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2d467c7a-ee45-4091-9fd6-8c467d189cf0 req-3337a25f-8141-4875-8001-dee52a4aa4a6 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1098 time: 0.0417216 Nov 15 12:49:56.831290 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2d467c7a-ee45-4091-9fd6-8c467d189cf0 req-76080f17-6fcc-49d5-b5ca-3f82d4701f3d service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493805 Nov 15 12:49:57.430058 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194e8058-56a3-496b-a7e5-45f35ce1deb3 req-0ef3f7ca-d719-4c16-a2f9-ec06e4c331a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:57.431936 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194e8058-56a3-496b-a7e5-45f35ce1deb3 req-0ef3f7ca-d719-4c16-a2f9-ec06e4c331a4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0617976 Nov 15 12:49:57.502822 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-194e8058-56a3-496b-a7e5-45f35ce1deb3 req-f624dd56-79da-4596-aba8-e62032f09bec tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0638835 Nov 15 12:49:58.386324 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57724) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:58.662158 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75a10a8-5f43-4ce0-8dbc-59e0a4197aaf req-cbfcb5d1-52e7-4e1a-bf9d-c493914db3d4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:58.663632 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c75a10a8-5f43-4ce0-8dbc-59e0a4197aaf req-cbfcb5d1-52e7-4e1a-bf9d-c493914db3d4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0882463 Nov 15 12:49:58.750925 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c75a10a8-5f43-4ce0-8dbc-59e0a4197aaf req-a55a70d5-ec60-4537-b757-daa73d1012f1 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0786808 Nov 15 12:49:58.830944 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:58.891254 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2604903b-7bfe-4390-85be-d1d3cc500f35 req-e8a2b8d9-027b-48c6-8a45-7bd61bf5bf72 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:58.892772 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2604903b-7bfe-4390-85be-d1d3cc500f35 req-e8a2b8d9-027b-48c6-8a45-7bd61bf5bf72 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0483754 Nov 15 12:49:58.958727 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-2604903b-7bfe-4390-85be-d1d3cc500f35 req-235d10dc-4373-4a1b-b6de-ffe1222879d5 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587871 Nov 15 12:49:58.981451 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57730) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:59.123317 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Deleting port 65376b5d-20e9-4d73-898c-67d942f03649 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:49:59.123724 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.194304 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d2ec860-9c99-4110-a17f-38f5e9d03209 tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:49:59.195814 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-2d2ec860-9c99-4110-a17f-38f5e9d03209 tempest-TestVolumeBootPattern-522639221 tempest-TestVolumeBootPattern-522639221-project-admin] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1093 time: 0.2133713 Nov 15 12:49:59.198749 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57736) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:49:59.203237 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.v2.base [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'port_id': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address': '172.20.0.7'}} {{(pid=108287) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:49:59.205183 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] For port 65376b5d-20e9-4d73-898c-67d942f03649, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=65376b5d-20e9-4d73-898c-67d942f03649,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:49:59.206017 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.221339 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Calling delete_port for 65376b5d-20e9-4d73-898c-67d942f03649 owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:49:59.227506 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.332212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.431479 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.462608 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_common [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Allocated IP 172.27.0.49 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/cd9ee64b-1cde-47d9-a53e-35bd664af863) {{(pid=108287) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:49:59.463575 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Pushing event deleted for resources: {'Port': ['ID=65376b5d-20e9-4d73-898c-67d942f03649,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:59.582595 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.634240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.663798 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:49:59.685804 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108287) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:49:59.691674 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.base_scheduler [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Resources bound (agent type, host, resource id): {{(pid=108287) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:49:59.695334 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Received port after_create {{(pid=108287) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:49:59.723185 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=cd9ee64b-1cde-47d9-a53e-35bd664af863,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:49:59.907042 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Router 807671ef-c6a8-4ec7-a17f-112ed19c0baa has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:50:00.023159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:50:00.033687 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a588a396-f0ce-4fb1-a816-293279be8d62 admin admin] 10.222.0.44 "PUT /v2.0/routers/807671ef-c6a8-4ec7-a17f-112ed19c0baa/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6461525 Nov 15 12:50:00.034384 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57738) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:00.040210 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Sync routers for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:50:00.054602 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:00.055203 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:00.076042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.164164 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks [] for router, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.172009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.181483 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:00.293675 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.349901 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for port, precommit_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.355843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29999020'] for port, after_update {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.360367 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Deleting port cd39133e-d1b0-409f-a75a-36f18f64e1b8 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:50:00.360975 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.432228 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event updated for resources: {'Port': ['ID=cd9ee64b-1cde-47d9-a53e-35bd664af863,revision_number=2']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:00.445219 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.479898 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13'}], 'enable_snat': True}, 'gw_port_id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:49:59Z', 'revision_number': 5, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port': {'id': 'cd39133e-d1b0-409f-a75a-36f18f64e1b8', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:f0:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 530, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:45:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:00.514269 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Checking router: 807671ef-c6a8-4ec7-a17f-112ed19c0baa for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:50:00.523771 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Routers {'807671ef-c6a8-4ec7-a17f-112ed19c0baa'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:00.524430 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:00.574177 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP c4f3ef62-2895-4913-84d1-7335d2e43071 associated. External IP: 172.27.0.49, port: 26bc9e42-8935-44bf-a2f2-37fddbc837c3. Nov 15 12:50:00.626583 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] Set router 807671ef-c6a8-4ec7-a17f-112ed19c0baa gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:00.700207 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:50:00Z', 'revision_number': 6, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:00.728490 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be05fbd5-e193-4ea3-ba7c-a482d6ade579 None None] The sync data for ids ['807671ef-c6a8-4ec7-a17f-112ed19c0baa'] in dv-cinder-803823-7-iscsi is: [{'id': '807671ef-c6a8-4ec7-a17f-112ed19c0baa', 'name': 'tempest-AttachVolumeTestJSON-745749199-router', 'tenant_id': '36f242c4967546e1b9d3186179668c38', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:45:03Z', 'updated_at': '2021-11-15T12:50:00Z', 'revision_number': 6, 'project_id': '36f242c4967546e1b9d3186179668c38', 'gw_port_host': None}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:50:00.739837 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] For port cd39133e-d1b0-409f-a75a-36f18f64e1b8, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cd39133e-d1b0-409f-a75a-36f18f64e1b8,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:50:00.740661 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.755339 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Calling delete_port for cd39133e-d1b0-409f-a75a-36f18f64e1b8 owned by network:router_gateway {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:50:00.805324 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:50:00.923998 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:50:00.935231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:50:00.953769 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:00.954119 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:00.954391 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:00.975757 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.016256 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-bccbf3fe-a18f-46f2-bc39-20b1075f8751 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8110790 Nov 15 12:50:01.016256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:50:01.016256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f9f4bf0-8912-4791-8c02-67d190cc9915" -d '{"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:50:01.028715 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Pushing event deleted for resources: {'Port': ['ID=cd39133e-d1b0-409f-a75a-36f18f64e1b8,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:01.106191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:50:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c70e5273-0e26-423d-841f-2469c5d3ff75 x-openstack-request-id: req-c70e5273-0e26-423d-841f-2469c5d3ff75 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:50:01.106191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:50:01.106191 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-c70e5273-0e26-423d-841f-2469c5d3ff75 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:50:01.106191 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'status': 'completed', 'code': 200} Nov 15 12:50:01.125556 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.126682 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:01.278180 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.279814 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 65376b5d-20e9-4d73-898c-67d942f03649 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:50:01.280887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.304091 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-0081be88-130d-4d82-9bab-cd72d31b4c92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:01.306623 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-0081be88-130d-4d82-9bab-cd72d31b4c92 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1098 time: 0.1390793 Nov 15 12:50:01.310571 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 65376b5d-20e9-4d73-898c-67d942f03649 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:50:01.310878 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 65376b5d-20e9-4d73-898c-67d942f03649 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:50:01.383188 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.383703 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Fanout notify agent at l3_agent the message router_deleted on router 807671ef-c6a8-4ec7-a17f-112ed19c0baa {{(pid=108286) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:50:01.388939 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.390210 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a4e4b695-2b09-46e6-a0c1-ac0740138efb admin admin] 10.222.0.44 "DELETE /v2.0/routers/807671ef-c6a8-4ec7-a17f-112ed19c0baa HTTP/1.1" status: 204 len: 168 time: 1.3546190 Nov 15 12:50:01.393161 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 57748) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:01.436376 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-899cb545-8ef4-4ed0-9b79-9d00f60215d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:01.438103 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-899cb545-8ef4-4ed0-9b79-9d00f60215d6 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.1009536 Nov 15 12:50:01.440444 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Deleting subnet 925098dd-312e-4533-8590-2a9da45326c8 {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:50:01.444614 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.470829 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}, {'id': 'c4f3ef62-2895-4913-84d1-7335d2e43071', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.49', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 669, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:12:0c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:49:59Z', 'updated_at': '2021-11-15T12:49:59Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:01.485762 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.497586 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:50:01.507000 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:01.508444 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:49:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:01.516615 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-819eeeee-16b5-4830-81a4-f1a0698333ff service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 998 time: 0.0678678 Nov 15 12:50:01.574947 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-b3913caf-25eb-461e-87b1-f3d379a8ef52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:01.577417 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-b3913caf-25eb-461e-87b1-f3d379a8ef52 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0525787 Nov 15 12:50:01.582617 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.635579 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-24205de8-2943-4041-ba72-3ec4d69d2bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:01.637145 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-24205de8-2943-4041-ba72-3ec4d69d2bc4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0526891 Nov 15 12:50:01.645951 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:01.651210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-97e3441f-72c7-41c9-b126-fbfbcdfebdfe service neutron] http://10.222.0.44:9696/v2.0/extensions returned with HTTP 200 {{(pid=108286) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 15 12:50:01.652241 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-97e3441f-72c7-41c9-b126-fbfbcdfebdfe service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0069110 Nov 15 12:50:01.672043 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.704578 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=925098dd-312e-4533-8590-2a9da45326c8,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:01.718366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.727360 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-23e279bb-d3e6-4189-969d-637e223eaeb8 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/925098dd-312e-4533-8590-2a9da45326c8 HTTP/1.1" status: 204 len: 168 time: 0.3293197 Nov 15 12:50:01.727619 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57754) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:01.739707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8cd398d-119e-4fb3-afd4-1e807a978c60 None None] Network d674a754-ca11-4d5c-be9e-426d0c193bcb requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:50:01.817881 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:01.835358 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-d27f9158-66f5-4109-a872-edc1b7cdc4b0 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1740818 Nov 15 12:50:01.971506 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Deleting port cff413bf-df61-4075-a7de-1561fe636ca9 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:50:01.971718 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.024749 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7f9f4bf0-8912-4791-8c02-67d190cc9915 req-0c61461e-2122-4150-b92e-17116e361b36 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1520209 Nov 15 12:50:02.053069 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] For port cff413bf-df61-4075-a7de-1561fe636ca9, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=cff413bf-df61-4075-a7de-1561fe636ca9,segment=NetworkSegment(6b28e91b-fc67-429b-a574-ffea38211fc9),segment_id=6b28e91b-fc67-429b-a574-ffea38211fc9)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:50:02.053750 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.077367 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Calling delete_port for cff413bf-df61-4075-a7de-1561fe636ca9 owned by network:dhcp {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:50:02.162182 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}, {'id': 'c4f3ef62-2895-4913-84d1-7335d2e43071', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.49', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 669, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:12:0c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:49:59Z', 'updated_at': '2021-11-15T12:49:59Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:02.167285 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.197189 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83e50406-6908-4086-9fc8-1fa86fd676ef None None] DHCP port deletion for d674a754-ca11-4d5c-be9e-426d0c193bcb request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:50:02.204085 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a41f49e-73cd-405a-9b69-231952ce5a05 None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}, {'id': 'c4f3ef62-2895-4913-84d1-7335d2e43071', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.49', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 669, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:12:0c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:49:59Z', 'updated_at': '2021-11-15T12:49:59Z', 'revision_number': 0, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:50:02.204819 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] No DVR routers for this DVR port cff413bf-df61-4075-a7de-1561fe636ca9 on host dv-cinder-803823-7-iscsi {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:50:02.205781 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Pushing event deleted for resources: {'Port': ['ID=cff413bf-df61-4075-a7de-1561fe636ca9,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:02.295820 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.320751 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d674a754-ca11-4d5c-be9e-426d0c193bcb']}} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:02.330006 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6b28e91b-fc67-429b-a574-ffea38211fc9') {'for_net_delete': True} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:02.330330 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.services.segments.db [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6b28e91b-fc67-429b-a574-ffea38211fc9') {} {{(pid=108286) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:02.341995 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30503400'] for segment, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.357369 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Releasing vlan 603 on physical network physnet1 to pool {{(pid=108286) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-30644548'] for segment, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: Traceback (most recent call last): Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: timer() Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: cb(*args, **kw) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: return func(*args, **kwargs) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: self._notify() Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: self.callback(batched_events) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: event.method(event) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: return f(self, *a, **k) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._get(url).json() Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: return self.request(url, 'GET', **kwargs) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:50:02.370539 dv-cinder-803823-7-iscsi neutron-server[108286]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:50:02.429092 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-052abdf2-1dc6-4390-a10a-131b3a92e759 None None] New status for floating IP c4f3ef62-2895-4913-84d1-7335d2e43071: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:50:02.440508 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.446965 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.450157 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] 10.222.0.44 "DELETE /v2.0/networks/d674a754-ca11-4d5c-be9e-426d0c193bcb HTTP/1.1" status: 204 len: 168 time: 0.7215850 Nov 15 12:50:02.461970 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2efbfa8d-828c-4d39-b2e7-89cc4e09727e admin admin] Pushing event deleted for resources: {'Network': ['ID=d674a754-ca11-4d5c-be9e-426d0c193bcb,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:02.676406 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57768) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:02.880861 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cff413bf-df61-4075-a7de-1561fe636ca9 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:50:02.881290 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-9d4e2e11-fd6b-4b88-b980-a8cef3fdb2cb admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=36f242c4967546e1b9d3186179668c38&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2036443 Nov 15 12:50:02.883703 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 57772) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:02.902584 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: cff413bf-df61-4075-a7de-1561fe636ca9 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:50:02.902932 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cff413bf-df61-4075-a7de-1561fe636ca9 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:50:02.903320 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cd39133e-d1b0-409f-a75a-36f18f64e1b8 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:50:02.927539 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: cd39133e-d1b0-409f-a75a-36f18f64e1b8 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:50:02.927889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device cd39133e-d1b0-409f-a75a-36f18f64e1b8 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:50:02.936845 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:02.960358 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:03.013529 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:03.016378 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:03.017622 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/0c0119d2-ff04-4963-a912-5b30aeee920c HTTP/1.1" status: 204 len: 168 time: 0.1328909 Nov 15 12:50:03.026134 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ece877-93c6-40e1-a9af-bda4f329465d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c0119d2-ff04-4963-a912-5b30aeee920c,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:03.349173 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-59a798c7-9020-44cb-8559-a05136715aa1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:05.786919 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-30aedf56-e185-4123-bbe3-728b72b5f207 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:06.896539 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:07.661262 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-ca7ec1e2-3c61-4fd1-95b2-422a1daa1715 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-548365070&fields=id&tenant_id=737743b16ec0418fb629805c6e0a1150 HTTP/1.1" status: 200 len: 267 time: 0.0439522 Nov 15 12:50:08.032693 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-34c4e3d3-72b0-4df0-9ef2-a3c98673fdd9 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:08.034153 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-34c4e3d3-72b0-4df0-9ef2-a3c98673fdd9 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 807 time: 0.3659258 Nov 15 12:50:08.048585 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-7a49c0ed-0ca0-426b-b5b3-47e986163058 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/quotas/737743b16ec0418fb629805c6e0a1150 HTTP/1.1" status: 200 len: 375 time: 0.0087750 Nov 15 12:50:08.096715 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-488837b2-0aae-4462-b687-dcc8eaa09983 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0430984 Nov 15 12:50:08.185768 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-bf3b9cb1-0c98-49df-a045-706079085324 service neutron] 10.222.0.44 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0779817 Nov 15 12:50:08.279400 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-c055844d-e1ed-4961-8db9-1e4ffb02bc34 service neutron] 10.222.0.44 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870697 Nov 15 12:50:08.361374 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:08.622511 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-30ce7daa-1ec4-45f3-b8df-3d278e515e9d req-2450dc12-349e-4f0b-91e2-afd2ad27d1e3 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 210 time: 0.0396969 Nov 15 12:50:08.767844 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:50:09.157210 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:09.724278 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ea68d1b7-ab60-4002-bebe-bec171723743 req-aa95eeef-93ca-4cb5-909d-da19b94e79ec tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 210 time: 0.0290313 Nov 15 12:50:09.760425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-47c50feb-0ea9-4bc6-bb47-17f34c00ae6f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:09.761993 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-47c50feb-0ea9-4bc6-bb47-17f34c00ae6f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 807 time: 0.1087008 Nov 15 12:50:09.855761 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-89d3d45e-f13d-4fc3-8e46-958d3c0aedc9 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=737743b16ec0418fb629805c6e0a1150 HTTP/1.1" status: 200 len: 379 time: 0.0702593 Nov 15 12:50:09.868200 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'port': {'device_id': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'admin_state_up': True, 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'security_groups': ['3597f45e-b04d-41cd-a10a-420b69e29085']}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:50:10.004766 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Made reservation on behalf of 737743b16ec0418fb629805c6e0a1150 for: {'port': 1} {{(pid=108286) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 15 12:50:10.008670 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.157988 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Allocated IP 172.20.0.12 (4df1794c-df61-4e22-9f30-ef1b263e82e8/7f869a7a-ae34-40e6-a819-d5a2784495c3/e1991a6d-8d86-410a-837e-f95d619a3f1d) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:50:10.321989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.363461 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.409992 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:50:10.413176 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:50:10.417609 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:50:10.443387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:10.476911 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:10.477562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.504344 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-60446ff0-4472-4247-8528-2518aeb2f8cb tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6397727 Nov 15 12:50:10.527059 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Request body: {'port': {'device_id': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80382'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:50:10.598355 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.623661 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0fa57481-7792-4683-bedc-a30d323a6c58 None None] Provisioning complete for port e1991a6d-8d86-410a-837e-f95d619a3f1d triggered by entity DHCP. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:50:10.624317 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0fa57481-7792-4683-bedc-a30d323a6c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.664059 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0fa57481-7792-4683-bedc-a30d323a6c58 None None] Port e1991a6d-8d86-410a-837e-f95d619a3f1d cannot update to ACTIVE because it is not bound. {{(pid=108288) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 15 12:50:10.882307 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3c4a32-e555-42ef-8c91-c82d4c96d567 req-0928bef7-7846-4e7a-b5b4-b383717be65d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:10.883789 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba3c4a32-e555-42ef-8c91-c82d4c96d567 req-0928bef7-7846-4e7a-b5b4-b383717be65d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 932 time: 0.0847561 Nov 15 12:50:10.954185 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e1991a6d-8d86-410a-837e-f95d619a3f1d {{(pid=108286) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:50:10.969874 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:10.978087 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-ba3c4a32-e555-42ef-8c91-c82d4c96d567 req-ed81f63e-fa87-4535-8d21-9cfec031dd03 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878141 Nov 15 12:50:10.988404 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.provisioning_blocks [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Transition to ACTIVE for port object e1991a6d-8d86-410a-837e-f95d619a3f1d will not be triggered until provisioned by entity L2. {{(pid=108286) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 15 12:50:10.992478 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:11.049418 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:11.131707 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Attempting to bind port e1991a6d-8d86-410a-837e-f95d619a3f1d on host hv-cinder-80382 for vnic_type normal with profile {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 15 12:50:11.132044 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Attempting to bind port e1991a6d-8d86-410a-837e-f95d619a3f1d by drivers openvswitch,hyperv on host hv-cinder-80382 at level 0 using segments [{'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 15 12:50:11.132412 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Attempting to bind port e1991a6d-8d86-410a-837e-f95d619a3f1d on network 4df1794c-df61-4e22-9f30-ef1b263e82e8 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:50:11.137540 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Port e1991a6d-8d86-410a-837e-f95d619a3f1d on network 4df1794c-df61-4e22-9f30-ef1b263e82e8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80382 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 15 12:50:11.138014 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Attempting to bind port e1991a6d-8d86-410a-837e-f95d619a3f1d on network 4df1794c-df61-4e22-9f30-ef1b263e82e8 {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 15 12:50:11.144491 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Checking agent: {'id': '592bf2e0-fd46-40f2-85fa-f9166c092772', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80382', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'started_at': datetime.datetime(2021, 11, 15, 12, 37, 42), 'heartbeat_timestamp': datetime.datetime(2021, 11, 15, 12, 49, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 15 12:50:11.144831 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Checking segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108286) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 15 12:50:11.145220 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Bound using segment: {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'} {{(pid=108286) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 15 12:50:11.145660 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.managers [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Bound port: e1991a6d-8d86-410a-837e-f95d619a3f1d, host: hv-cinder-80382, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8a8142da-1d36-489e-be0d-5441b680bb36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8'}}] {{(pid=108286) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 15 12:50:11.146020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:11.228093 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, cleared binding levels {{(pid=108286) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 15 12:50:11.232274 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108286) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 15 12:50:11.242538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:11.289390 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:11.290210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:11.292628 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] 10.222.0.61 "PUT /v2.0/ports/e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 1094 time: 0.7709999 Nov 15 12:50:11.293164 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:50:11.295672 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74f5595b-c9a3-4525-95ec-55d7db98caa4" -d '{"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:50:11.339110 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e60bec1-eb82-4804-be78-71079b94c1a6 service neutron] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=3']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:11.353446 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:50:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a2ff17d-8ff5-48c0-8b19-0f54dd9c08b6 x-openstack-request-id: req-8a2ff17d-8ff5-48c0-8b19-0f54dd9c08b6 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:50:11.354166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:50:11.355304 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-8a2ff17d-8ff5-48c0-8b19-0f54dd9c08b6 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:50:11.355998 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'status': 'completed', 'code': 200} Nov 15 12:50:11.439693 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-f0f917d9-3b18-4d38-9126-e2dd0c29d3f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:11.441865 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-f0f917d9-3b18-4d38-9126-e2dd0c29d3f3 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1097 time: 0.0526996 Nov 15 12:50:11.498546 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-6e29a83e-b1bf-4362-88fa-e7f2861116a5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 217 time: 0.0370593 Nov 15 12:50:11.557648 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-d805f9bf-4dfe-4264-b10e-b36ee26e291d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:11.559135 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-d805f9bf-4dfe-4264-b10e-b36ee26e291d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0530148 Nov 15 12:50:11.608392 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-1e1e2de4-4e26-47ac-868b-e7e24435eca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:11.609223 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-1e1e2de4-4e26-47ac-868b-e7e24435eca6 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419221 Nov 15 12:50:11.702503 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-c0438432-f9a1-47e7-8e0d-193c8677d156 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823045 Nov 15 12:50:11.802226 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-df9c9deb-694d-4186-8899-9c6209e02a50 req-883242c7-3f46-4b37-bf9a-90fa0f9eade0 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882051 Nov 15 12:50:11.952019 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-a20fcaa0-27fd-43cd-963f-b5c9cfdaea07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:11.953553 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-a20fcaa0-27fd-43cd-963f-b5c9cfdaea07 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1097 time: 0.0422330 Nov 15 12:50:12.092136 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-5fde1183-2b20-4b70-9bc7-341ad5406362 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:12.093494 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-5fde1183-2b20-4b70-9bc7-341ad5406362 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.1306436 Nov 15 12:50:12.152367 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aebb190-676e-47a6-9b69-cc510643b56b req-dc383077-7390-4b1b-86d3-127971f26243 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:12.153845 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2aebb190-676e-47a6-9b69-cc510643b56b req-dc383077-7390-4b1b-86d3-127971f26243 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0991390 Nov 15 12:50:12.155628 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-c2be6dde-3550-4917-9463-ea0c91ccae44 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 217 time: 0.0538688 Nov 15 12:50:12.244931 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-fb366e48-b4f5-489d-979e-224d46e5246c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:12.249595 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-fb366e48-b4f5-489d-979e-224d46e5246c service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0726690 Nov 15 12:50:12.250411 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2aebb190-676e-47a6-9b69-cc510643b56b req-5b8854a2-5128-4c8e-8fa9-25baaaae0e76 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0904140 Nov 15 12:50:12.303989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-62c940c9-f54c-47de-a042-6ab46afa275b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:12.305521 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-62c940c9-f54c-47de-a042-6ab46afa275b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0462651 Nov 15 12:50:12.401850 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-9036c11a-6dd1-439b-aad1-59f1c87b5032 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876002 Nov 15 12:50:12.499097 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-74f5595b-c9a3-4525-95ec-55d7db98caa4 req-7d3d703a-c5cf-48fa-81de-654c2060d596 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835559 Nov 15 12:50:13.369038 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186b31cc-264d-4088-8e68-684074a35e34 req-c7bafc56-f913-4998-ab50-9b4c26d466db tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:13.370479 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-186b31cc-264d-4088-8e68-684074a35e34 req-c7bafc56-f913-4998-ab50-9b4c26d466db tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0493155 Nov 15 12:50:13.421637 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-186b31cc-264d-4088-8e68-684074a35e34 req-010d71cd-e369-48b7-8a20-0156a100d9f8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452228 Nov 15 12:50:14.120931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:14.544509 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37769a17-3bbb-4be7-960d-b11b03b7858b req-79b7196e-e7db-4858-b681-a63fad0d0a7e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:14.546050 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37769a17-3bbb-4be7-960d-b11b03b7858b req-79b7196e-e7db-4858-b681-a63fad0d0a7e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0567553 Nov 15 12:50:14.598147 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-37769a17-3bbb-4be7-960d-b11b03b7858b req-af8ceb7f-c825-4512-9f70-dfa06ca26c93 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449631 Nov 15 12:50:15.713174 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42ce1f3-2b2f-4122-9cc1-1ce7e89cd556 req-e61bbd14-52ba-4888-8b8d-afe870dc7d33 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:15.714600 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a42ce1f3-2b2f-4122-9cc1-1ce7e89cd556 req-e61bbd14-52ba-4888-8b8d-afe870dc7d33 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0489244 Nov 15 12:50:15.762071 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-a42ce1f3-2b2f-4122-9cc1-1ce7e89cd556 req-9ad79529-30d1-457e-95f1-5c0b95838895 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414829 Nov 15 12:50:16.895238 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ebb6b6-8ec3-4f7d-bb28-9b33e3e0a0c8 req-a573c850-c348-4ab3-964b-27903438a6b4 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:16.896751 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-39ebb6b6-8ec3-4f7d-bb28-9b33e3e0a0c8 req-a573c850-c348-4ab3-964b-27903438a6b4 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0532393 Nov 15 12:50:16.962688 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-39ebb6b6-8ec3-4f7d-bb28-9b33e3e0a0c8 req-2807f449-3fbb-42ed-af18-ee0e9371974e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0594418 Nov 15 12:50:18.088794 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d08fd0-da06-4b77-b995-396f6a302d2a req-d46ae483-9dc4-4888-9166-9469809816dc tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:18.090283 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-86d08fd0-da06-4b77-b995-396f6a302d2a req-d46ae483-9dc4-4888-9166-9469809816dc tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0577810 Nov 15 12:50:18.142535 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-86d08fd0-da06-4b77-b995-396f6a302d2a req-bacc05a6-063c-4fa6-9aab-90be14f5b939 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458541 Nov 15 12:50:19.264209 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2684b2d2-0d71-4a18-8cd7-1cc987250e85 req-6b69adc9-aeeb-4ebd-a053-a90ae435336a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:19.266900 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2684b2d2-0d71-4a18-8cd7-1cc987250e85 req-6b69adc9-aeeb-4ebd-a053-a90ae435336a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0558953 Nov 15 12:50:19.319441 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2684b2d2-0d71-4a18-8cd7-1cc987250e85 req-25980dbe-15f4-4a5d-8ed9-f70f0c600579 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469739 Nov 15 12:50:19.582868 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58036) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:19.689659 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dccfe992-6f06-4030-8cc3-f6cb6993cb0e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.767164 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dccfe992-6f06-4030-8cc3-f6cb6993cb0e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.770934 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-dccfe992-6f06-4030-8cc3-f6cb6993cb0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.807294 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dccfe992-6f06-4030-8cc3-f6cb6993cb0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e2a5c77-b395-4e3b-994f-df4435c79fe3,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:19.811667 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-dccfe992-6f06-4030-8cc3-f6cb6993cb0e admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=1765a153676f47acb76915844feadb93&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2277007 Nov 15 12:50:19.814193 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58040) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:19.862254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.883570 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.933639 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.936315 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:19.937456 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/2e2a5c77-b395-4e3b-994f-df4435c79fe3 HTTP/1.1" status: 204 len: 168 time: 0.1223741 Nov 15 12:50:19.945450 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049a55ca-ae88-44a4-94aa-da4c372213a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e2a5c77-b395-4e3b-994f-df4435c79fe3,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:20.210413 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58046) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:20.223229 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f9198f50-7c85-4c46-bfc2-ff4c12d136bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.294691 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f9198f50-7c85-4c46-bfc2-ff4c12d136bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.298633 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-f9198f50-7c85-4c46-bfc2-ff4c12d136bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.335358 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9198f50-7c85-4c46-bfc2-ff4c12d136bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e972187f-95fe-4d9e-b958-9ec987ddd7fd,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:20.339467 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-f9198f50-7c85-4c46-bfc2-ff4c12d136bd admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=e7445a7295f3440b9b6cb32910fa3c30&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1280110 Nov 15 12:50:20.343671 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58050) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:20.397351 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.419500 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.445270 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020735c9-a596-4874-afda-f7c0691bea1c req-d5354f55-b645-445f-aa7c-ee4beb13cc67 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:20.446731 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-020735c9-a596-4874-afda-f7c0691bea1c req-d5354f55-b645-445f-aa7c-ee4beb13cc67 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0539820 Nov 15 12:50:20.468946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.471577 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.472775 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/e972187f-95fe-4d9e-b958-9ec987ddd7fd HTTP/1.1" status: 204 len: 168 time: 0.1281087 Nov 15 12:50:20.480844 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdaf36ac-4cb6-4c03-9d67-faaa1be94453 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e972187f-95fe-4d9e-b958-9ec987ddd7fd,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:20.486679 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:50:20.524544 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-020735c9-a596-4874-afda-f7c0691bea1c req-458f06fc-577a-4646-ab08-4090ed28a7ae tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695920 Nov 15 12:50:20.604567 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:50:20.616362 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'mac_address': 'fa:16:3e:7e:1f:82', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 617, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:50:20.656380 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.671032 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1991a6d-8d86-410a-837e-f95d619a3f1d {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:50:20.706283 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:50:20.713055 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:20.764649 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=4']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:21.067989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['e1991a6d-8d86-410a-837e-f95d619a3f1d'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:50:21.645073 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb4064d8-c265-4db9-ba23-84216803d45f req-dcbb7c38-5d87-41d1-8828-e31fd8cf3903 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:21.646593 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fb4064d8-c265-4db9-ba23-84216803d45f req-dcbb7c38-5d87-41d1-8828-e31fd8cf3903 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 945 time: 0.0573812 Nov 15 12:50:21.707656 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-fb4064d8-c265-4db9-ba23-84216803d45f req-aa38f4cd-a60b-44b3-9372-20e42a547967 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546942 Nov 15 12:50:22.483672 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:50:22.536106 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning for port e1991a6d-8d86-410a-837e-f95d619a3f1d completed by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 15 12:50:22.540489 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port e1991a6d-8d86-410a-837e-f95d619a3f1d triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:50:22.540858 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:22.623468 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:22.650307 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:50:22.652879 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dd03ff0-6d49-4481-b330-0c52390572bc" -d '{"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-plugged", "status": "completed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:50:22.673163 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:50:22.677943 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:22.711827 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:50:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5fdf4ea0-b646-49a9-ac46-6e93f4484ea5 x-openstack-request-id: req-5fdf4ea0-b646-49a9-ac46-6e93f4484ea5 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:50:22.712145 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-plugged", "status": "completed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:50:22.712399 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-5fdf4ea0-b646-49a9-ac46-6e93f4484ea5 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:50:22.712792 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'code': 200} Nov 15 12:50:22.747032 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=5']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:22.839562 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b662d126-64b9-4418-a11c-9b53f8b827ad req-579e3dcc-6983-4202-ab67-5d1255f2c45d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:22.841153 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b662d126-64b9-4418-a11c-9b53f8b827ad req-579e3dcc-6983-4202-ab67-5d1255f2c45d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0516844 Nov 15 12:50:22.900715 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-b662d126-64b9-4418-a11c-9b53f8b827ad req-6275d4c6-4e33-4614-aa7f-58e5add7a6b7 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471478 Nov 15 12:50:23.097250 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-850f8bb3-05c4-4b23-bbc1-2714bb901f86 req-d5c211cf-3d26-407b-b904-4c8a0201dbf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:23.098741 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-850f8bb3-05c4-4b23-bbc1-2714bb901f86 req-d5c211cf-3d26-407b-b904-4c8a0201dbf4 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.1511648 Nov 15 12:50:23.149202 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-850f8bb3-05c4-4b23-bbc1-2714bb901f86 req-3e2ff256-9643-403a-b436-3a6927be1561 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426910 Nov 15 12:50:24.025504 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f6beed-af13-45d1-9b02-13ecc615a012 req-c6c42ca9-0d5d-4501-a90b-24877eaaf76a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:24.027059 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-42f6beed-af13-45d1-9b02-13ecc615a012 req-c6c42ca9-0d5d-4501-a90b-24877eaaf76a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0509024 Nov 15 12:50:24.079350 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-42f6beed-af13-45d1-9b02-13ecc615a012 req-82d9e935-845f-4af9-bcd8-f580e089c393 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463428 Nov 15 12:50:25.195506 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6c6a65-a1c8-4386-810f-f84458034108 req-cfd1b972-ac08-4e9f-b66b-e1547e785bf5 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:25.197068 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7c6c6a65-a1c8-4386-810f-f84458034108 req-cfd1b972-ac08-4e9f-b66b-e1547e785bf5 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0496764 Nov 15 12:50:25.247261 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-7c6c6a65-a1c8-4386-810f-f84458034108 req-2a045f1f-e2b9-4659-9b0b-5a05adda5b05 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441988 Nov 15 12:50:26.366534 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb20c38-df3b-4a32-b489-fae483bdb9b7 req-062ef27c-cd06-435b-aa8a-7331c8bfd7e8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:26.368062 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ccb20c38-df3b-4a32-b489-fae483bdb9b7 req-062ef27c-cd06-435b-aa8a-7331c8bfd7e8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0530758 Nov 15 12:50:26.419267 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ccb20c38-df3b-4a32-b489-fae483bdb9b7 req-ea59549e-a791-4917-838a-3b43963358c2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451896 Nov 15 12:50:27.537460 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666e1c5f-d199-49a0-b31d-86f71df09a98 req-2fc4bcc3-80fa-4fd2-89e9-2fd49ad29645 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:27.538959 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666e1c5f-d199-49a0-b31d-86f71df09a98 req-2fc4bcc3-80fa-4fd2-89e9-2fd49ad29645 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0505407 Nov 15 12:50:27.590046 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-666e1c5f-d199-49a0-b31d-86f71df09a98 req-e3ffe20d-eca3-49b5-99ae-343bcf845e2e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448506 Nov 15 12:50:27.720862 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2715da-d1cc-4d03-8e6a-d911a05d2e41 req-4daa6bbd-1752-4083-8e23-e67926ab7fce tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:27.722350 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aa2715da-d1cc-4d03-8e6a-d911a05d2e41 req-4daa6bbd-1752-4083-8e23-e67926ab7fce tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0521529 Nov 15 12:50:27.774718 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-aa2715da-d1cc-4d03-8e6a-d911a05d2e41 req-a27c7d4f-2fe5-4e25-a283-df111196965f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464466 Nov 15 12:50:27.801501 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58136) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:27.991053 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c652d1c2-c99e-404d-8e36-f407d570ebf8 tempest-TestShelveInstance-1462565013 tempest-TestShelveInstance-1462565013-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:27.994099 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c652d1c2-c99e-404d-8e36-f407d570ebf8 tempest-TestShelveInstance-1462565013 tempest-TestShelveInstance-1462565013-project-admin] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1094 time: 0.1915498 Nov 15 12:50:28.001743 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58146) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:28.009507 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.v2.base [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Request body: {'floatingip': {'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'fixed_ip_address': '172.20.0.12'}} {{(pid=108286) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 15 12:50:28.037989 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for floatingip, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:28.144265 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:28.253267 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_common [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Allocated IP 172.27.0.86 (45831433-abc0-4e27-bccd-5aeb94543032/f0a0a193-a36f-4db1-9bc0-b984b6129445/b6cffc50-b40e-4680-a242-4a6dbba95e79) {{(pid=108286) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 15 12:50:28.354969 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for port, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:28.388625 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738060186022', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:28.432592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Network 45831433-abc0-4e27-bccd-5aeb94543032 is already hosted by enough agents. {{(pid=108286) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 15 12:50:28.435398 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.base_scheduler [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Resources bound (agent type, host, resource id): {{(pid=108286) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 15 12:50:28.438079 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Received port after_create {{(pid=108286) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 15 12:50:28.462757 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'Port': ['ID=b6cffc50-b40e-4680-a242-4a6dbba95e79,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:28.476071 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.476431 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.476770 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.477124 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.477443 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.477771 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.478088 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.478402 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.478719 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.479031 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.479345 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.479655 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:28.800502 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:28.871629 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:29.025330 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for port, precommit_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:29.029538 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-30644520'] for port, after_update {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:29.094951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event updated for resources: {'Port': ['ID=b6cffc50-b40e-4680-a242-4a6dbba95e79,revision_number=2']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:29.110804 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-33077951'] for floatingip, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:29.211981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.db.l3_db [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Floating IP d0c257b5-236c-46a6-b58c-18ef9653a7fe associated. External IP: 172.27.0.86, port: e1991a6d-8d86-410a-837e-f95d619a3f1d. Nov 15 12:50:29.677545 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:50:29.785398 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:50:29.795687 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Sync routers for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:50:29.804403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:29.805392 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:29.806074 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:50:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:29.832768 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-9c54cec1-b99d-4abc-b133-b2fe00685293 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8297517 Nov 15 12:50:29.833333 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:50:29.835697 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad" -d '{"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:50:29.917800 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:30.003887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:50:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95998a56-b82f-42d4-b2aa-fc3b1d21893c x-openstack-request-id: req-95998a56-b82f-42d4-b2aa-fc3b1d21893c {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:50:30.003887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:50:30.003887 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-95998a56-b82f-42d4-b2aa-fc3b1d21893c {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:50:30.004296 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'status': 'completed', 'code': 200} Nov 15 12:50:30.153841 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'd0c257b5-236c-46a6-b58c-18ef9653a7fe', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'floating_ip_address': '172.27.0.86', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'mac_address': 'fa:16:3e:7e:1f:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:50:28Z', 'updated_at': '2021-11-15T12:50:28Z', 'revision_number': 0, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:30.180812 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Checking router: b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:50:30.189450 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:50:30.189975 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:50:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:30.296187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:50:30.522824 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'd0c257b5-236c-46a6-b58c-18ef9653a7fe', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'floating_ip_address': '172.27.0.86', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'mac_address': 'fa:16:3e:7e:1f:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:50:28Z', 'updated_at': '2021-11-15T12:50:28Z', 'revision_number': 0, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:50:30.551472 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08ce6a6e-6647-4f5c-a737-5609bf964d59 None None] The sync data for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi is: [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'd0c257b5-236c-46a6-b58c-18ef9653a7fe', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'floating_ip_address': '172.27.0.86', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'mac_address': 'fa:16:3e:7e:1f:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:50:28Z', 'updated_at': '2021-11-15T12:50:28Z', 'revision_number': 0, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:50:30.746607 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e5406ea-0cae-4162-bb1a-ad54d26d3622 None None] New status for floating IP d0c257b5-236c-46a6-b58c-18ef9653a7fe: ACTIVE {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:50:31.138455 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-5fdd6192-8d89-424f-a0b7-418023bdbd5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:31.140289 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-5fdd6192-8d89-424f-a0b7-418023bdbd5e service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.0428684 Nov 15 12:50:31.243278 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-97e231d1-01d2-40a6-93fd-4338685e68a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:31.249066 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-97e231d1-01d2-40a6-93fd-4338685e68a0 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.0960717 Nov 15 12:50:31.321435 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-2902b554-a6c2-47c3-8ea5-8ddf6276e2c5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 1001 time: 0.0669043 Nov 15 12:50:31.377529 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-92699ad7-12cc-4e05-999a-446d6d9a39e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:31.379511 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-92699ad7-12cc-4e05-999a-446d6d9a39e2 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0476565 Nov 15 12:50:31.433402 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-cfbbe97f-fc65-445e-b186-844aaed8fdf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:31.434901 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-cfbbe97f-fc65-445e-b186-844aaed8fdf8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0482645 Nov 15 12:50:31.526202 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-3eef1e96-3fc7-4bd9-9fac-1a0c4327e4da service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828683 Nov 15 12:50:31.619993 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0ac5866-5bec-42ff-8cc2-136a9a70d6ad req-484d0648-d725-4725-93ae-139adf49acf4 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866482 Nov 15 12:50:33.349809 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d394e277-a50f-4bc6-a5c4-0261c39c6bc5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:35.790407 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0d2e5a89-a74f-49e6-9900-12cfab2e1451 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:36.897889 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:38.357884 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:39.152732 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:44.131501 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:45.767904 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:50:49.501968 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-3a65fe5b-b2ef-41c5-9016-b0be58c58b8d service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0444348 Nov 15 12:50:49.622753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-56007f18-d491-442c-929c-feaadcfe0e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:49.624298 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-56007f18-d491-442c-929c-feaadcfe0e4c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1098 time: 0.0489850 Nov 15 12:50:49.740638 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-d4d6068f-f50e-4b81-8e22-52a943e7f0d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:49.742106 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-d4d6068f-f50e-4b81-8e22-52a943e7f0d2 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.0933697 Nov 15 12:50:49.812736 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-e4c15d39-8b42-4f94-8a02-5425b4af8b36 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 1001 time: 0.0625229 Nov 15 12:50:49.874699 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-0ccd301e-b2bd-4165-90e8-742cbda55a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:49.876218 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-0ccd301e-b2bd-4165-90e8-742cbda55a8c service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0551491 Nov 15 12:50:49.935321 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-2405a148-498e-4bd6-a160-c3cb1f991ed5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:50:49.940398 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-2405a148-498e-4bd6-a160-c3cb1f991ed5 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477259 Nov 15 12:50:50.047530 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-acd8015f-47ae-407d-960e-88e5dd2f5025 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0981615 Nov 15 12:50:50.161411 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f25b2fe3-c8ec-4f7b-b040-ffdd3de23196 req-aca5db2b-fc7e-4668-86eb-dd781cfa0499 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1016335 Nov 15 12:50:52.652839 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58302) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:52.768675 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9f8746d-b147-4952-9e49-cb7ee7f87ff4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:52.851642 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9f8746d-b147-4952-9e49-cb7ee7f87ff4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:52.855777 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a9f8746d-b147-4952-9e49-cb7ee7f87ff4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:52.894826 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a9f8746d-b147-4952-9e49-cb7ee7f87ff4 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=f596d3df0a884580a2143d1a3ab3a4e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2408426 Nov 15 12:50:52.897597 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58306) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:52.900412 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f8746d-b147-4952-9e49-cb7ee7f87ff4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9415faa-bb4b-48cd-96c5-c79098dcff55,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:52.956470 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:52.980389 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.032877 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.035998 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.039296 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/d9415faa-bb4b-48cd-96c5-c79098dcff55 HTTP/1.1" status: 204 len: 168 time: 0.1386056 Nov 15 12:50:53.050412 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b017d3a1-a9ab-4041-bd60-2fcbf9cae18d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9415faa-bb4b-48cd-96c5-c79098dcff55,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:53.348632 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58312) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:53.361447 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eef8d6c6-f856-4a90-8c05-9c4433b185cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.439781 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eef8d6c6-f856-4a90-8c05-9c4433b185cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.447258 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-eef8d6c6-f856-4a90-8c05-9c4433b185cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.489897 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef8d6c6-f856-4a90-8c05-9c4433b185cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88186c67-3cd2-4e74-a572-4e4dea5476e2,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:53.495217 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-eef8d6c6-f856-4a90-8c05-9c4433b185cb admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=14787a04746b45ab80577c15ef7b7e8e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1454794 Nov 15 12:50:53.498258 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58314) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:53.567714 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.597267 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.661981 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.664765 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:53.666193 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/88186c67-3cd2-4e74-a572-4e4dea5476e2 HTTP/1.1" status: 204 len: 168 time: 0.1668303 Nov 15 12:50:53.675469 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6538ac2a-9c46-4e35-aa5b-2c8d861a5035 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88186c67-3cd2-4e74-a572-4e4dea5476e2,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:54.892147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58348) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:55.016542 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.103670 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.108283 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.149151 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=17fce100911d4889a87dd8ae739761cc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2556634 Nov 15 12:50:55.150212 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71310147-6ee3-4fa8-bd3e-e13fad96d840,revision_number=1']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:50:55.152027 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58352) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:50:55.159143 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.159486 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.159825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.160754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.160754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.161120 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.161284 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.161499 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.161825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.162145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.162463 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.162778 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8f48e6c-3609-447b-956e-4f8c33a40c7c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:50:55.212246 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.233705 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.286739 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.291082 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:50:55.293184 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/71310147-6ee3-4fa8-bd3e-e13fad96d840 HTTP/1.1" status: 204 len: 168 time: 0.1397145 Nov 15 12:50:55.307611 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e5f782-e227-43a5-b12b-7b2e74c1a268 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71310147-6ee3-4fa8-bd3e-e13fad96d840,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:03.349105 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-fd2b2544-4b69-412c-a5ae-5ab34db77dba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.484674 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58428) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:51:04.601242 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8847d35-1f5e-4585-a202-f41c36961780 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.682249 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8847d35-1f5e-4585-a202-f41c36961780 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.686700 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-a8847d35-1f5e-4585-a202-f41c36961780 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_create {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.732476 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-a8847d35-1f5e-4585-a202-f41c36961780 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=5a2b0d10621544e6a9d8d5d02c9f1937&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2464466 Nov 15 12:51:04.733316 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8847d35-1f5e-4585-a202-f41c36961780 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15955d62-b3c7-439b-9303-58befade2217,revision_number=1']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:04.735298 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58432) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:51:04.793861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.818220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.874592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.877658 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:04.882676 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/15955d62-b3c7-439b-9303-58befade2217 HTTP/1.1" status: 204 len: 168 time: 0.1419172 Nov 15 12:51:04.894681 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca57dde0-c113-457d-89a1-c8011806df7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15955d62-b3c7-439b-9303-58befade2217,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:05.795224 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1f33cc33-4f20-4ea9-bfee-4bedc7172290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:06.899298 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:08.360328 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:09.155756 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:14.132092 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:22.767372 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:51:33.341372 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7f95b956-ed0e-4ff8-8208-fa37811bd036 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:35.797164 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3322daa8-8cdb-41aa-9e92-3e5e635f1d49 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:36.900369 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:38.361901 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:39.157488 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:44.145775 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:49.389559 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-5e8643d3-496e-4aea-a93f-54cd2b36c1e7 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0403907 Nov 15 12:51:49.464980 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-1df768db-dc3d-4ff0-abd8-27f6659a90f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:49.466381 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-1df768db-dc3d-4ff0-abd8-27f6659a90f8 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1098 time: 0.0421937 Nov 15 12:51:49.569314 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-9d328dfc-41d4-457a-b66c-b3c8565b3474 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:49.570746 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-9d328dfc-41d4-457a-b66c-b3c8565b3474 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.0829172 Nov 15 12:51:49.638747 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-a798391c-d539-48ee-b226-b4c28dad147f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 1000 time: 0.0602129 Nov 15 12:51:49.688166 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-e35c718b-49b3-41e8-ae5b-81802bb5e3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:49.689670 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-e35c718b-49b3-41e8-ae5b-81802bb5e3ad service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0433261 Nov 15 12:51:49.736839 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-d87b71d8-84bc-4b68-b301-867d41c1d763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:49.738361 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-d87b71d8-84bc-4b68-b301-867d41c1d763 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388615 Nov 15 12:51:49.831058 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-d3a4b937-8f7c-4832-9e6f-1a099750b275 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837116 Nov 15 12:51:49.918798 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-0cf7b28b-3469-4e12-a899-ed7162128f63 req-6ebd4c66-8066-4ff3-867a-3911c81434d2 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801916 Nov 15 12:51:51.539373 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58448) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:51:51.694882 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port cd9ee64b-1cde-47d9-a53e-35bd664af863 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:51:51.695211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:51.767549 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:51.767869 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:51.779042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for cd9ee64b-1cde-47d9-a53e-35bd664af863 owned by network:floatingip {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:51:51.943080 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:51.968461 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=cd9ee64b-1cde-47d9-a53e-35bd664af863,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:52.028871 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:52.029251 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP c4f3ef62-2895-4913-84d1-7335d2e43071 disassociated (deleted). External IP: 172.27.0.49, port: 26bc9e42-8935-44bf-a2f2-37fddbc837c3. Nov 15 12:51:52.236861 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:51:52.341379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:51:52.346712 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:52.351524 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:51:52.361185 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:51:52.361776 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:51:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:52.372319 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d8033f85-79ea-4c38-853a-8e36bddf2292 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "DELETE /v2.0/floatingips/c4f3ef62-2895-4913-84d1-7335d2e43071 HTTP/1.1" status: 204 len: 168 time: 0.8318567 Nov 15 12:51:52.372883 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:51:52.375133 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9bc5878-d220-4d3d-a8d6-13475a302409" -d '{"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:51:52.472994 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:51:52.613825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247c035d-b067-40e2-9450-8f0806457efe req-2d26e1b8-a1f2-425f-951e-adcebc8e2786 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:52.615564 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-247c035d-b067-40e2-9450-8f0806457efe req-2d26e1b8-a1f2-425f-951e-adcebc8e2786 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0578978 Nov 15 12:51:52.632211 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:51:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-853da549-a974-415a-895b-4391c1f82c7a x-openstack-request-id: req-853da549-a974-415a-895b-4391c1f82c7a {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:51:52.632545 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:51:52.632756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-853da549-a974-415a-895b-4391c1f82c7a {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:51:52.633143 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'status': 'completed', 'code': 200} Nov 15 12:51:52.674325 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-247c035d-b067-40e2-9450-8f0806457efe req-4590bda8-3712-45a9-9fd8-58fd05f5b0d7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519047 Nov 15 12:51:52.732480 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-4f33c193-f52b-4c5f-97e7-1f5422e97019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:52.734128 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-4f33c193-f52b-4c5f-97e7-1f5422e97019 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 1098 time: 0.0477414 Nov 15 12:51:52.842165 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-880b4817-0a71-4a40-844b-f288441e3208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:52.843665 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-880b4817-0a71-4a40-844b-f288441e3208 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.0999939 Nov 15 12:51:52.865333 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:52.893597 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:51:52.894431 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-69d5d32f-48e3-42b6-bc0b-35a9c6084449 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 200 len: 217 time: 0.0386679 Nov 15 12:51:52.905649 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:51:52.906250 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:51:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:52.951403 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-f869d39a-9921-4eb2-bc37-1c3c2f651721 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:52.952893 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-f869d39a-9921-4eb2-bc37-1c3c2f651721 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0495148 Nov 15 12:51:53.009418 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-b2fc25f7-4247-4ce4-aa56-f149c7539327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:53.011165 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-b2fc25f7-4247-4ce4-aa56-f149c7539327 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415521 Nov 15 12:51:53.017569 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:51:53.112766 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-56f07df0-8741-46d6-bab1-4d3e1eeb503a service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936449 Nov 15 12:51:53.209270 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a9bc5878-d220-4d3d-a8d6-13475a302409 req-d5521c4e-37af-49db-a883-ed9b494db9c1 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856645 Nov 15 12:51:53.255773 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:53.282514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a0f37a8-3411-47e0-8dd2-7ac2b56b799f None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_floatingips': [{'id': 'b480dbe5-e37c-437f-82f0-dc1d144359fa', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'floating_ip_address': '172.27.0.161', 'floating_network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'router_id': '9debd778-08e0-487d-9344-378c464d56b4', 'port_id': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 585, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'mac_address': 'fa:16:3e:10:9c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-15T12:47:49Z', 'updated_at': '2021-11-15T12:47:51Z', 'revision_number': 1, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:51:53.500852 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecd2e21a-02d5-4ca4-bee2-bb609badb095 None None] New status for floating IP c4f3ef62-2895-4913-84d1-7335d2e43071: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:51:53.810560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3249ed66-31b5-4128-a0ca-2cd94fe67f76 req-dba319ab-0b92-4aea-ab48-0f8c54cc2277 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:53.811999 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3249ed66-31b5-4128-a0ca-2cd94fe67f76 req-dba319ab-0b92-4aea-ab48-0f8c54cc2277 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0506361 Nov 15 12:51:53.867599 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3249ed66-31b5-4128-a0ca-2cd94fe67f76 req-60659868-0c35-4716-9c25-9e7a8d48dcb4 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496829 Nov 15 12:51:54.596100 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-b324fff8-6472-47c4-8321-95b3be424a1d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:54.597546 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-b324fff8-6472-47c4-8321-95b3be424a1d tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 945 time: 0.0479438 Nov 15 12:51:54.690534 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:51:54.690861 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:54.780719 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] For port 26bc9e42-8935-44bf-a2f2-37fddbc837c3, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=26bc9e42-8935-44bf-a2f2-37fddbc837c3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:51:54.781074 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:54.794094 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for 26bc9e42-8935-44bf-a2f2-37fddbc837c3 owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:51:54.921020 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:54.951679 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=26bc9e42-8935-44bf-a2f2-37fddbc837c3,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:54.964763 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.965143 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.965372 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.965709 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.966039 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.966371 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.966699 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.967023 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.967350 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.967810 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.968037 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.968387 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:54.968943 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-069ea96a-5504-46ff-84d3-9be5d815db16 req-9d20b75b-2db2-4d3d-bbb1-b670960386bc tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ba439818-4fe0-46b2-83be-ed54830db80d HTTP/1.1" status: 200 len: 210 time: 0.0300703 Nov 15 12:51:55.003159 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] No DVR routers for this DVR port 26bc9e42-8935-44bf-a2f2-37fddbc837c3 on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:51:55.006212 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:55.009536 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d705d6d9-5878-42a3-8d6d-094f9486233a req-14968bde-aa5a-425a-80b4-d0bed8cb8eff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "DELETE /v2.0/ports/26bc9e42-8935-44bf-a2f2-37fddbc837c3 HTTP/1.1" status: 204 len: 173 time: 0.4050782 Nov 15 12:51:55.009977 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'name': 'network-vif-deleted', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:51:55.012810 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4bea6f94-53a1-477d-8a0c-a03d138b3ad0" -d '{"events": [{"server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "name": "network-vif-deleted", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:51:55.057425 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:51:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b56e8f7-39ca-4e15-ab62-6d1dee48869a x-openstack-request-id: req-6b56e8f7-39ca-4e15-ab62-6d1dee48869a {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:51:55.057717 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba439818-4fe0-46b2-83be-ed54830db80d", "name": "network-vif-deleted", "tag": "26bc9e42-8935-44bf-a2f2-37fddbc837c3", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:51:55.057969 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6b56e8f7-39ca-4e15-ab62-6d1dee48869a {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:51:55.058366 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba439818-4fe0-46b2-83be-ed54830db80d', 'name': 'network-vif-deleted', 'tag': '26bc9e42-8935-44bf-a2f2-37fddbc837c3', 'status': 'completed', 'code': 200} Nov 15 12:51:56.983214 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 26bc9e42-8935-44bf-a2f2-37fddbc837c3 no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:51:57.003581 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 26bc9e42-8935-44bf-a2f2-37fddbc837c3 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:51:57.003909 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 26bc9e42-8935-44bf-a2f2-37fddbc837c3 not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:51:58.247437 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58488) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:51:58.401280 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port 6e25fdfb-620e-4df7-8353-71b7f74b78ee {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:51:58.401617 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:58.473278 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:58.473600 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:58.485104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for 6e25fdfb-620e-4df7-8353-71b7f74b78ee owned by network:floatingip {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:51:58.629905 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:58.654500 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=6e25fdfb-620e-4df7-8353-71b7f74b78ee,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:51:58.679493 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.679837 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.680193 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.680523 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.680851 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.681175 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.681497 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.681820 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.682139 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.682453 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.682768 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.683081 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:51:58.726230 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:58.726489 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Floating IP b480dbe5-e37c-437f-82f0-dc1d144359fa disassociated (deleted). External IP: 172.27.0.161, port: 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a. Nov 15 12:51:58.929149 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:51:59.031833 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:51:59.036409 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:51:59.041047 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:51:59.050757 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:51:59.051350 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:51:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:59.062071 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8b609031-7846-47e9-9b82-c7649e5646f3 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "DELETE /v2.0/floatingips/b480dbe5-e37c-437f-82f0-dc1d144359fa HTTP/1.1" status: 204 len: 168 time: 0.8135614 Nov 15 12:51:59.062628 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:51:59.065003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-455cfb15-45a7-4665-ae15-0e82b1952715" -d '{"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:51:59.109904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:51:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d36da5ab-1123-4275-bf7c-20949016d11e x-openstack-request-id: req-d36da5ab-1123-4275-bf7c-20949016d11e {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:51:59.110192 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:51:59.110442 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-d36da5ab-1123-4275-bf7c-20949016d11e {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:51:59.110845 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'status': 'completed', 'code': 200} Nov 15 12:51:59.167534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:51:59.214284 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-879a2a65-398f-4777-8c48-385ee567fc26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:59.215834 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-879a2a65-398f-4777-8c48-385ee567fc26 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=ad165f3ffe59498e88611526ef4c254d&device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 1098 time: 0.0573273 Nov 15 12:51:59.311817 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992aed3a-abb6-40e1-a6e9-a0da7e2b2d24 req-ee938e4c-2c92-4bb2-acf4-7f1d36f952d6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:59.316648 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-992aed3a-abb6-40e1-a6e9-a0da7e2b2d24 req-ee938e4c-2c92-4bb2-acf4-7f1d36f952d6 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0575063 Nov 15 12:51:59.370360 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-992aed3a-abb6-40e1-a6e9-a0da7e2b2d24 req-a35b028a-f806-4471-8175-a29e64829e2a tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0498772 Nov 15 12:51:59.382984 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-7853aac5-0d03-4934-916a-ef7280cab8a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:59.392054 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-7853aac5-0d03-4934-916a-ef7280cab8a6 service neutron] 10.222.0.61 "GET /v2.0/networks?id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 200 len: 912 time: 0.1069722 Nov 15 12:51:59.404397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:59.431853 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:51:59.436926 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-969e33b1-dff9-443a-b6e9-4621059eecce service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 200 len: 217 time: 0.0397413 Nov 15 12:51:59.440674 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:51:59.441278 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:51:36Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:59.494721 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-f4768c97-35b6-45e8-9b0d-177c3a84be50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:59.496220 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-f4768c97-35b6-45e8-9b0d-177c3a84be50 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 200 len: 850 time: 0.0490324 Nov 15 12:51:59.547712 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-7423643f-793f-4854-acf2-0f2b991f9afc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:51:59.550193 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-7423643f-793f-4854-acf2-0f2b991f9afc service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0446837 Nov 15 12:51:59.555091 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:51:59.657587 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-61a3739b-30f2-450a-a87f-2be1f7305624 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0985711 Nov 15 12:51:59.756076 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-455cfb15-45a7-4665-ae15-0e82b1952715 req-42e752b9-f47f-4866-a5b4-0a332740f459 service neutron] 10.222.0.61 "GET /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883002 Nov 15 12:51:59.764311 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:51:59.773845 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:51:59.796745 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bfbd503-b5fb-4c95-bdeb-df8b4875bd3d None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:42:44Z', 'revision_number': 4, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '987bb19a-6a1a-4482-b727-c4a8e9b2f55c', 'name': '', 'network_id': '7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'mac_address': 'fa:16:3e:26:6f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:42Z', 'updated_at': '2021-11-15T12:42:53Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'subnets': [{'id': '2a6efff2-9e7d-4592-b2fe-44911cde042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:52:00.024698 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9affef09-a983-4738-9339-8c0ad8342925 None None] New status for floating IP b480dbe5-e37c-437f-82f0-dc1d144359fa: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:52:00.499296 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd65acbb-9910-4d4e-a19a-fe16485c8c2b req-a71d26d3-58c7-4e41-9904-f56337df36ff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:00.500867 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd65acbb-9910-4d4e-a19a-fe16485c8c2b req-a71d26d3-58c7-4e41-9904-f56337df36ff tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0486665 Nov 15 12:52:00.563322 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-cd65acbb-9910-4d4e-a19a-fe16485c8c2b req-e75cadc7-1afb-4099-bb03-0b3eea920e40 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/security-groups?id=f5f8a6e7-eff7-4cff-a4f3-64559906341e&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511503 Nov 15 12:52:01.092946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-b592cdf9-5eac-40e3-b0d1-d4f9ef2764f8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:01.094369 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-b592cdf9-5eac-40e3-b0d1-d4f9ef2764f8 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 945 time: 0.0491228 Nov 15 12:52:01.187971 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:01.188254 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:01.278737 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] For port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:01.279098 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:01.291059 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:01.414724 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:01.444820 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=7dc03216-eb2b-4d3e-8246-eb7309dc3e9a,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:01.487054 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] No DVR routers for this DVR port 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:52:01.489524 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:01.493466 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2ae9fbaf-82e7-4e08-b019-d5c1aceb500c req-f77ac721-4957-4606-b32a-b7fce021f2e0 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.61 "DELETE /v2.0/ports/7dc03216-eb2b-4d3e-8246-eb7309dc3e9a HTTP/1.1" status: 204 len: 173 time: 0.3914316 Nov 15 12:52:01.493923 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'name': 'network-vif-deleted', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:52:01.496269 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fa26c7a-d87a-45e6-92af-58b7311362d5" -d '{"events": [{"server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "name": "network-vif-deleted", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:52:01.535252 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:52:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1378bd87-fb66-4213-91f1-c804bf674862 x-openstack-request-id: req-1378bd87-fb66-4213-91f1-c804bf674862 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:52:01.535941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff5c9c0d-3236-42aa-85e5-d0700b0b2584", "name": "network-vif-deleted", "tag": "7dc03216-eb2b-4d3e-8246-eb7309dc3e9a", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:52:01.535941 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-1378bd87-fb66-4213-91f1-c804bf674862 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:52:01.536186 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff5c9c0d-3236-42aa-85e5-d0700b0b2584', 'name': 'network-vif-deleted', 'tag': '7dc03216-eb2b-4d3e-8246-eb7309dc3e9a', 'status': 'completed', 'code': 200} Nov 15 12:52:01.678440 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-2eb4ad0e-8d50-4208-9f70-25cfafefe900 req-8b654ee1-f4d8-41d6-9185-51fd1b8f85ec tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "GET /v2.0/ports?device_id=ff5c9c0d-3236-42aa-85e5-d0700b0b2584 HTTP/1.1" status: 200 len: 210 time: 0.0303771 Nov 15 12:52:02.733751 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58504) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:02.851506 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Deleting port 286ef0a5-b060-410b-bd75-5b7daf8bc19b {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:02.851838 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:02.928442 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:02.928761 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:02.939825 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Calling delete_port for 286ef0a5-b060-410b-bd75-5b7daf8bc19b owned by network:floatingip {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:03.013760 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:03.034179 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:03.034427 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device 7dc03216-eb2b-4d3e-8246-eb7309dc3e9a not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:03.068104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:03.095692 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'Port': ['ID=286ef0a5-b060-410b-bd75-5b7daf8bc19b,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:03.155336 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for floatingip, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:03.158253 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:03.159403 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f34b66e5-00fd-47f8-b59e-fdc9708473e7 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "DELETE /v2.0/floatingips/2ed2e1f6-c353-477a-a6df-fdfd10382523 HTTP/1.1" status: 204 len: 168 time: 0.4246516 Nov 15 12:52:03.348318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a2790dd0-18f6-4000-8d1c-b88767ebe9c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:04.346096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58516) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:04.401822 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:04.425812 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:04.482323 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:04.485012 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:04.486154 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] 10.222.0.44 "DELETE /v2.0/security-groups/f5f8a6e7-eff7-4cff-a4f3-64559906341e HTTP/1.1" status: 204 len: 168 time: 0.1390803 Nov 15 12:52:04.495727 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27dffaf7-a02f-410c-aab0-1f15c019f801 tempest-TestVolumeBootPattern-129071523 tempest-TestVolumeBootPattern-129071523-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5f8a6e7-eff7-4cff-a4f3-64559906341e,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:04.543459 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58520) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:05.015971 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:05.252402 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Deleting port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:05.252739 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:05.327017 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] For port 987bb19a-6a1a-4482-b727-c4a8e9b2f55c, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:05.327375 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:05.340307 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Calling delete_port for 987bb19a-6a1a-4482-b727-c4a8e9b2f55c owned by network:router_interface {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:05.519732 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:05.548995 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Pushing event deleted for resources: {'Port': ['ID=987bb19a-6a1a-4482-b727-c4a8e9b2f55c,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:05.798333 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-996fa3af-aec1-411b-a494-7304b52986ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:05.965126 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.172008 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Router 9debd778-08e0-487d-9344-378c464d56b4 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:52:06.272281 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:52:06.277167 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-73877dc6-087b-4164-bd27-5f1695e2bf0b admin admin] 10.222.0.44 "PUT /v2.0/routers/9debd778-08e0-487d-9344-378c464d56b4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7326875 Nov 15 12:52:06.279745 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58524) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:06.280669 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Sync routers for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:52:06.291101 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:52:06.291703 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:52:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:06.381042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks [] for router, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.393718 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:52:06.482462 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.538063 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Deleting port 18ef0c61-7468-4e28-958e-8c15da1775b6 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:06.538774 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.622181 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] For port 18ef0c61-7468-4e28-958e-8c15da1775b6, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=18ef0c61-7468-4e28-958e-8c15da1775b6,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:06.622565 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.634326 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Calling delete_port for 18ef0c61-7468-4e28-958e-8c15da1775b6 owned by network:router_gateway {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:06.691885 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137'}], 'enable_snat': True}, 'gw_port_id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:52:05Z', 'revision_number': 5, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port': {'id': '18ef0c61-7468-4e28-958e-8c15da1775b6', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:6f:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9debd778-08e0-487d-9344-378c464d56b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 413, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:37Z', 'updated_at': '2021-11-15T12:42:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:06.721483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Checking router: 9debd778-08e0-487d-9344-378c464d56b4 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:52:06.730495 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Routers {'9debd778-08e0-487d-9344-378c464d56b4'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:52:06.731105 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:52:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['9debd778-08e0-487d-9344-378c464d56b4'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:06.792912 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.816307 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] Set router 9debd778-08e0-487d-9344-378c464d56b4 gateway port host: None {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:52:06.819104 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Pushing event deleted for resources: {'Port': ['ID=18ef0c61-7468-4e28-958e-8c15da1775b6,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:06.875821 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:52:06Z', 'revision_number': 6, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:06.892868 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.914922 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d2de6f5-3c8d-4932-b2ed-a35c47b42422 None None] The sync data for ids ['9debd778-08e0-487d-9344-378c464d56b4'] in dv-cinder-803823-7-iscsi is: [{'id': '9debd778-08e0-487d-9344-378c464d56b4', 'name': 'tempest-TestVolumeBootPattern-829156122-router', 'tenant_id': 'ad165f3ffe59498e88611526ef4c254d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:36Z', 'updated_at': '2021-11-15T12:52:06Z', 'revision_number': 6, 'project_id': 'ad165f3ffe59498e88611526ef4c254d', 'gw_port_host': None}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:52:06.931164 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.987399 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:06.989586 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.037735 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.038266 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9debd778-08e0-487d-9344-378c464d56b4 {{(pid=108287) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:52:07.043534 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.044691 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-cb27a887-845e-4101-a912-7dd3e88c60fa admin admin] 10.222.0.44 "DELETE /v2.0/routers/9debd778-08e0-487d-9344-378c464d56b4 HTTP/1.1" status: 204 len: 168 time: 0.7639832 Nov 15 12:52:07.047144 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58526) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:07.091650 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Deleting subnet 2a6efff2-9e7d-4592-b2fe-44911cde042e {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:52:07.094716 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.128036 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.209342 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.260466 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.281914 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2a6efff2-9e7d-4592-b2fe-44911cde042e,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:07.291516 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.296655 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fc94f9e8-0f6d-42a4-b1c7-938d1fb92e85 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/2a6efff2-9e7d-4592-b2fe-44911cde042e HTTP/1.1" status: 204 len: 168 time: 0.2484012 Nov 15 12:52:07.297583 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60babd44-3e93-45e9-81d8-bd5cb5abecce None None] Network 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:52:07.298525 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58528) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:07.374249 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.426136 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Deleting port 081bceef-923f-4e85-aba5-adeeda34bdd3 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:07.426465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.487282 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] For port 081bceef-923f-4e85-aba5-adeeda34bdd3, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=081bceef-923f-4e85-aba5-adeeda34bdd3,segment=NetworkSegment(10a7f5a3-60bf-4073-9982-3736ed07544b),segment_id=10a7f5a3-60bf-4073-9982-3736ed07544b)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:07.487657 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.499271 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Calling delete_port for 081bceef-923f-4e85-aba5-adeeda34bdd3 owned by network:dhcp {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:07.577232 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.602264 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Pushing event deleted for resources: {'Port': ['ID=081bceef-923f-4e85-aba5-adeeda34bdd3,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:07.605682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] No DVR routers for this DVR port 081bceef-923f-4e85-aba5-adeeda34bdd3 on host dv-cinder-803823-7-iscsi {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:52:07.678465 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.700397 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:07.710712 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cb887bb-6588-465d-b405-92a763e4ea4d None None] DHCP port deletion for 7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:52:07.713117 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '10a7f5a3-60bf-4073-9982-3736ed07544b') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:07.713416 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '10a7f5a3-60bf-4073-9982-3736ed07544b') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:07.724950 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.738260 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.745145 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Releasing vlan 636 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:52:07.745538 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:52:07.747168 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:52:07.799845 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.805914 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:07.809029 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] 10.222.0.44 "DELETE /v2.0/networks/7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f HTTP/1.1" status: 204 len: 168 time: 0.5093234 Nov 15 12:52:07.812080 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58530) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:07.820090 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebd0478-8d67-4c6b-9342-02844337fe87 admin admin] Pushing event deleted for resources: {'Network': ['ID=7cc62e79-b5e9-4e64-a43c-9d6e4036ee4f,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:08.153912 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:08.365076 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:08.642798 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Deleting port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:08.643135 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:08.720381 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] For port 9e3e5a57-202b-4956-9bfa-1efe13e22ab3, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:08.720759 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:08.733145 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Calling delete_port for 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:08.910047 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:08.919672 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 081bceef-923f-4e85-aba5-adeeda34bdd3 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:08.938926 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 081bceef-923f-4e85-aba5-adeeda34bdd3 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:08.939263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 081bceef-923f-4e85-aba5-adeeda34bdd3 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:08.939687 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 987bb19a-6a1a-4482-b727-c4a8e9b2f55c no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:08.940736 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Pushing event deleted for resources: {'Port': ['ID=9e3e5a57-202b-4956-9bfa-1efe13e22ab3,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:08.961847 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 987bb19a-6a1a-4482-b727-c4a8e9b2f55c {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:08.962797 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 987bb19a-6a1a-4482-b727-c4a8e9b2f55c not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:08.963006 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 18ef0c61-7468-4e28-958e-8c15da1775b6 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:08.982576 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 18ef0c61-7468-4e28-958e-8c15da1775b6 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:08.982947 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 18ef0c61-7468-4e28-958e-8c15da1775b6 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:09.106850 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.162841 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.321439 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:52:09.423592 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:52:09.429054 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-d8711d5c-4ab4-4693-973e-32729f62df8e admin admin] 10.222.0.44 "PUT /v2.0/routers/d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6159143 Nov 15 12:52:09.431846 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58532) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:09.432919 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Sync routers for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:52:09.442295 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:52:09.442935 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:52:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:09.533759 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks [] for router, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.544414 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:52:09.633016 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.691725 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Deleting port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:09.691955 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.722057 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71'}], 'enable_snat': True}, 'gw_port_id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:52:08Z', 'revision_number': 5, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port': {'id': '061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:54:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.71', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:42:53Z', 'updated_at': '2021-11-15T12:43:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:09.747874 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Checking router: d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:52:09.756539 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Routers {'d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:52:09.757329 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:52:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:09.773014 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] For port 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:09.773399 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.785261 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Calling delete_port for 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf owned by network:router_gateway {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:09.922003 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] Set router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:52:09.948686 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:09.971613 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Pushing event deleted for resources: {'Port': ['ID=061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:09.976798 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:52:09Z', 'revision_number': 6, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:10.004892 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9846d746-73c9-4a0b-8ae8-605831aa3626 None None] The sync data for ids ['d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca'] in dv-cinder-803823-7-iscsi is: [{'id': 'd8c5e1aa-1f26-49d0-bf8f-8047bcf678ca', 'name': 'tempest-TestVolumeBootPattern-642166694-router', 'tenant_id': 'b86de3bb49114d96be728d8c8451d18a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:42:51Z', 'updated_at': '2021-11-15T12:52:09Z', 'revision_number': 6, 'project_id': 'b86de3bb49114d96be728d8c8451d18a', 'gw_port_host': None}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:52:10.035659 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.127952 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.130078 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.173892 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.174618 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca {{(pid=108287) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:52:10.180624 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.181850 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fd4af77e-913f-417c-b2a0-68c58fa8a172 admin admin] 10.222.0.44 "DELETE /v2.0/routers/d8c5e1aa-1f26-49d0-bf8f-8047bcf678ca HTTP/1.1" status: 204 len: 168 time: 0.7489898 Nov 15 12:52:10.184352 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58534) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:10.226964 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Deleting subnet 33272a70-5cfb-4c4a-a5ae-771ac2aef484 {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:52:10.230151 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.262587 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.341384 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.397146 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.423592 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=33272a70-5cfb-4c4a-a5ae-771ac2aef484,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:10.426674 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.429723 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-917cd93d-cd85-41d1-9141-5555f6252290 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/33272a70-5cfb-4c4a-a5ae-771ac2aef484 HTTP/1.1" status: 204 len: 168 time: 0.2443221 Nov 15 12:52:10.432095 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58536) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:10.432735 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-865d3f58-d4f7-4c85-81e2-1d0a3a5571a3 None None] Network 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:52:10.500003 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.552921 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Deleting port b71dec3c-c92c-47fe-828a-34ca9a4aad09 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:52:10.553256 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.613555 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] For port b71dec3c-c92c-47fe-828a-34ca9a4aad09, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=b71dec3c-c92c-47fe-828a-34ca9a4aad09,segment=NetworkSegment(b9d446ec-d69d-4086-b2dc-ff17004bdb41),segment_id=b9d446ec-d69d-4086-b2dc-ff17004bdb41)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:10.613907 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.625522 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Calling delete_port for b71dec3c-c92c-47fe-828a-34ca9a4aad09 owned by network:dhcp {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:52:10.704000 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.728529 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Pushing event deleted for resources: {'Port': ['ID=b71dec3c-c92c-47fe-828a-34ca9a4aad09,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:10.731919 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] No DVR routers for this DVR port b71dec3c-c92c-47fe-828a-34ca9a4aad09 on host dv-cinder-803823-7-iscsi {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:52:10.773766 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b2f6cdf-46cd-40ee-9c46-94aefe5afeed None None] DHCP port deletion for 6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:52:10.805645 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.825336 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:10.834833 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b9d446ec-d69d-4086-b2dc-ff17004bdb41') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:10.835125 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b9d446ec-d69d-4086-b2dc-ff17004bdb41') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:52:10.844470 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.860564 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.868548 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Releasing vlan 607 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:52:10.868734 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:52:10.870669 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:52:10.925956 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.934526 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:10.938127 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] 10.222.0.44 "DELETE /v2.0/networks/6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d HTTP/1.1" status: 204 len: 168 time: 0.5048602 Nov 15 12:52:10.946231 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:10.951664 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75dedde7-f2a9-4ed8-bb92-a6f4a16308a3 admin admin] Pushing event deleted for resources: {'Network': ['ID=6f2a2d99-aa27-4d34-a171-7bfeb6f9bb5d,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:10.975648 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:10.975989 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 9e3e5a57-202b-4956-9bfa-1efe13e22ab3 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:10.976419 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device b71dec3c-c92c-47fe-828a-34ca9a4aad09 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:10.997470 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: b71dec3c-c92c-47fe-828a-34ca9a4aad09 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:10.997811 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device b71dec3c-c92c-47fe-828a-34ca9a4aad09 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:10.998431 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:11.021833 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:52:11.022170 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 061f4e0e-2d1f-4aed-ae6f-8e3e0ec24fcf not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:52:11.076409 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58540) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:11.119502 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-95986669-f297-447d-a29b-03c4a4b9089b admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=ad165f3ffe59498e88611526ef4c254d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0417895 Nov 15 12:52:11.122009 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58542) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:11.168662 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.190566 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.236786 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.239856 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.241026 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/15383770-9ba2-43c3-94ef-2b9b96306017 HTTP/1.1" status: 204 len: 168 time: 0.1180212 Nov 15 12:52:11.248665 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb2ed110-30b0-4cca-ac0d-1cc0b13db6eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15383770-9ba2-43c3-94ef-2b9b96306017,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:11.544388 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58548) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:11.583501 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b001d4e6-9070-42f9-b8c9-cc99df457162 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=b86de3bb49114d96be728d8c8451d18a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0378935 Nov 15 12:52:11.585904 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58550) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:52:11.630497 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.651092 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.696875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.699300 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:11.700423 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/0ff79f09-4304-4615-adcb-d0eaf0dfa1d4 HTTP/1.1" status: 204 len: 168 time: 0.1136091 Nov 15 12:52:11.707817 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-747014af-7d5c-4cbd-ad35-7f1fc54b4106 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ff79f09-4304-4615-adcb-d0eaf0dfa1d4,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:14.172274 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:33.344674 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-cfaabef1-d6a9-4de2-80c2-7710f258ed7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:34.806946 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48620ea3-1a79-4259-a9bc-7f814547a777 req-db64987e-4239-4cb1-a1c7-e0b9b62abd94 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:34.808553 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48620ea3-1a79-4259-a9bc-7f814547a777 req-db64987e-4239-4cb1-a1c7-e0b9b62abd94 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0509946 Nov 15 12:52:34.861593 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-48620ea3-1a79-4259-a9bc-7f814547a777 req-10ef960d-33f4-4bab-b2e1-aaec4a9965a0 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465574 Nov 15 12:52:35.801234 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-05af34bc-c53b-4593-b310-3a2229c40ef5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:35.978585 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334be289-aa91-4d40-bf18-80228cedb74e req-d6699105-cca9-4822-b4de-21bfc9ff80d3 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:35.980040 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-334be289-aa91-4d40-bf18-80228cedb74e req-d6699105-cca9-4822-b4de-21bfc9ff80d3 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0481496 Nov 15 12:52:36.028276 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-334be289-aa91-4d40-bf18-80228cedb74e req-fed6101b-c248-4dfe-a9c6-ad8b12a0384c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422997 Nov 15 12:52:36.776767 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:52:36.906226 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:37.144855 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34510d8a-29d5-4e38-8756-f073675a1086 req-45d0bf7c-807f-4a35-a491-6f26ab4fcf60 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:37.146312 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-34510d8a-29d5-4e38-8756-f073675a1086 req-45d0bf7c-807f-4a35-a491-6f26ab4fcf60 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0481563 Nov 15 12:52:37.194562 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-34510d8a-29d5-4e38-8756-f073675a1086 req-a345eb81-36d4-4d75-97e4-f69984d0eeca tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423620 Nov 15 12:52:38.314664 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae62c60-ead8-4630-8d20-026057e98a98 req-7857c193-2986-472f-9065-c675ad8e579c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:38.316174 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4ae62c60-ead8-4630-8d20-026057e98a98 req-7857c193-2986-472f-9065-c675ad8e579c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0486968 Nov 15 12:52:38.364234 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4ae62c60-ead8-4630-8d20-026057e98a98 req-0f12d2ec-659d-41a3-bfca-01661f875602 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422208 Nov 15 12:52:38.368836 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:39.154543 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:39.482117 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d868a97-4f84-40d1-a8e9-7d33fb276126 req-2a69ef0a-e58c-48e5-bd68-7d1e081878ed tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:39.483567 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9d868a97-4f84-40d1-a8e9-7d33fb276126 req-2a69ef0a-e58c-48e5-bd68-7d1e081878ed tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0516856 Nov 15 12:52:39.533573 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9d868a97-4f84-40d1-a8e9-7d33fb276126 req-50d0a733-8865-4d5c-8222-a7cc26f378c6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436571 Nov 15 12:52:40.652955 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbe7359-080b-48fd-80cb-116cc1eb4730 req-23fa1031-61e8-4c9f-96a3-dca8a1e76c5b tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:40.654396 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5bbe7359-080b-48fd-80cb-116cc1eb4730 req-23fa1031-61e8-4c9f-96a3-dca8a1e76c5b tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0511832 Nov 15 12:52:40.702548 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-5bbe7359-080b-48fd-80cb-116cc1eb4730 req-b0b41280-f9d1-4280-9d4a-e4c4385f89b6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423028 Nov 15 12:52:41.818619 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f42d4b-08a2-4198-9707-7c62664a6928 req-425951ab-9023-465e-9d13-ee8affe44171 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:41.820107 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0f42d4b-08a2-4198-9707-7c62664a6928 req-425951ab-9023-465e-9d13-ee8affe44171 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0488744 Nov 15 12:52:41.870810 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-f0f42d4b-08a2-4198-9707-7c62664a6928 req-bc93053c-99f1-4690-a9bc-f7b00571cbcf tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442853 Nov 15 12:52:42.989977 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec12e5e-2a5f-46a0-aa87-64e011765592 req-5b32208a-1a43-4b53-b244-70c7858da69f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:42.991423 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eec12e5e-2a5f-46a0-aa87-64e011765592 req-5b32208a-1a43-4b53-b244-70c7858da69f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0475008 Nov 15 12:52:43.038982 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-eec12e5e-2a5f-46a0-aa87-64e011765592 req-77abc62d-8e8d-474e-876c-ac6ff13d623b tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416861 Nov 15 12:52:44.153183 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f78a04c-7c5e-4bf3-ac9d-1c2535e60b93 req-e77825bd-09e9-492b-9868-562417003a7e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:44.154651 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f78a04c-7c5e-4bf3-ac9d-1c2535e60b93 req-e77825bd-09e9-492b-9868-562417003a7e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0495563 Nov 15 12:52:44.176297 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:44.208589 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-9f78a04c-7c5e-4bf3-ac9d-1c2535e60b93 req-2672bc41-7cfc-4ba1-b71c-a30efbeacf2d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477505 Nov 15 12:52:45.013178 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b61c34-07dd-4866-a36f-088830b14c76 req-d2338dff-e9ef-4e43-be00-22556ea8d478 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:45.014640 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-d2338dff-e9ef-4e43-be00-22556ea8d478 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.0403268 Nov 15 12:52:45.105977 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b61c34-07dd-4866-a36f-088830b14c76 req-03f22d1a-19c3-42f0-a5f6-8f87d5a2279c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:45.107435 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-03f22d1a-19c3-42f0-a5f6-8f87d5a2279c service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.0839834 Nov 15 12:52:45.177962 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-d9946269-b201-4bfd-ba58-da43e9c4448b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 1001 time: 0.0610883 Nov 15 12:52:45.231595 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b61c34-07dd-4866-a36f-088830b14c76 req-6414f528-2267-4165-a78b-b47a29023cee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:45.233094 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-6414f528-2267-4165-a78b-b47a29023cee service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0474854 Nov 15 12:52:45.279604 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b61c34-07dd-4866-a36f-088830b14c76 req-12ae53a3-0036-4c8d-b042-9f9877537e87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:45.281116 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-12ae53a3-0036-4c8d-b042-9f9877537e87 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402663 Nov 15 12:52:45.322291 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2651416-08e2-458e-afc7-4e03831e86b6 req-566e1731-839e-4be0-9bf9-842403e3aea8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:45.323738 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b2651416-08e2-458e-afc7-4e03831e86b6 req-566e1731-839e-4be0-9bf9-842403e3aea8 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0497777 Nov 15 12:52:45.374125 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b2651416-08e2-458e-afc7-4e03831e86b6 req-9a454641-6e57-47c2-b2af-8b13f1ef4cb2 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443256 Nov 15 12:52:45.377077 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-f02693e4-ebec-4968-ae66-63001d3b9f7d service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863726 Nov 15 12:52:45.470156 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-29b61c34-07dd-4866-a36f-088830b14c76 req-c2066219-348a-43f1-a9fc-ee2882d1fe8c service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854580 Nov 15 12:52:46.490906 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c75b42-7210-4bb2-b537-2c0ba317c755 req-6bff6050-4762-49e1-88f0-fe899c2b497f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:46.492469 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-23c75b42-7210-4bb2-b537-2c0ba317c755 req-6bff6050-4762-49e1-88f0-fe899c2b497f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0496793 Nov 15 12:52:46.547605 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-23c75b42-7210-4bb2-b537-2c0ba317c755 req-08941a59-f20b-408c-80e3-ec34e4c8f113 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486789 Nov 15 12:52:47.673599 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd2e2d1-01aa-47a6-8655-ab17a11f1121 req-28d34917-2749-4c4e-97c2-390ba56ed2ab tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:47.674993 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4bd2e2d1-01aa-47a6-8655-ab17a11f1121 req-28d34917-2749-4c4e-97c2-390ba56ed2ab tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0552599 Nov 15 12:52:47.727465 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-4bd2e2d1-01aa-47a6-8655-ab17a11f1121 req-fa15c12d-e4d3-4b29-b70d-b82595091c6f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456927 Nov 15 12:52:48.967613 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4ed312-b65b-478d-85f8-2a30bde20d4e req-5efa8bb4-56d6-48ef-a454-9b490872310d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:48.969088 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d4ed312-b65b-478d-85f8-2a30bde20d4e req-5efa8bb4-56d6-48ef-a454-9b490872310d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0486522 Nov 15 12:52:49.017123 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-9d4ed312-b65b-478d-85f8-2a30bde20d4e req-b0c1203c-8028-467e-bb04-ea0ac7bac49f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421438 Nov 15 12:52:49.131908 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-2554aecc-6031-426f-8dc2-2e0d04de2163 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2299278 Nov 15 12:52:49.232005 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:52:49.307774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:49.329152 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:52:49.331345 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c2a1bdb-9512-465e-95fe-d8e3898b9a3e" -d '{"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-unplugged", "status": "completed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:52:49.343556 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:52:49.347910 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:52:49.399408 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=6']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:52:49.406187 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.406533 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.406864 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.407188 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.407511 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.407836 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.408174 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.408494 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.408811 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.409128 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.409442 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.409751 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:52:49.503094 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 15 Nov 2021 12:52:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d30734dc-cbcb-4ab8-a7fa-48b82c697ae5 x-openstack-request-id: req-d30734dc-cbcb-4ab8-a7fa-48b82c697ae5 {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:52:49.503382 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-unplugged", "status": "failed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "code": 422}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:52:49.503625 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-d30734dc-cbcb-4ab8-a7fa-48b82c697ae5 {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:52:49.504013 dv-cinder-803823-7-iscsi neutron-server[108288]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'code': 422} returned with failed status Nov 15 12:52:50.129661 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1917b34-0d93-4305-96be-6af8877d8ceb req-6017f7c3-665b-42f1-acba-6ae5df9b013f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:50.131097 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f1917b34-0d93-4305-96be-6af8877d8ceb req-6017f7c3-665b-42f1-acba-6ae5df9b013f tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0484524 Nov 15 12:52:50.179391 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-f1917b34-0d93-4305-96be-6af8877d8ceb req-d513dc75-dad6-433f-93ff-2bca91a5f50d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423548 Nov 15 12:52:51.294262 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c393056-90ca-489e-bf15-457637588d40 req-62231e00-39ad-4ee2-91e7-7ec137de224d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:51.295769 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6c393056-90ca-489e-bf15-457637588d40 req-62231e00-39ad-4ee2-91e7-7ec137de224d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0497816 Nov 15 12:52:51.346756 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-6c393056-90ca-489e-bf15-457637588d40 req-d361c85a-a71b-4747-b4bc-d2657631b33a tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426421 Nov 15 12:52:52.465846 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbcafa9-64d6-4f60-bef3-df98d9715a94 req-21754df0-dd3b-4333-88a2-d4e50a7efd67 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:52.467342 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bcbcafa9-64d6-4f60-bef3-df98d9715a94 req-21754df0-dd3b-4333-88a2-d4e50a7efd67 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0516374 Nov 15 12:52:52.517543 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-bcbcafa9-64d6-4f60-bef3-df98d9715a94 req-de5d6bcd-b053-4c23-a6ea-f9ce08708eff tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439706 Nov 15 12:52:52.716593 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-2bca162d-df09-4789-9be8-8b7bd21d36cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:52.717959 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-2bca162d-df09-4789-9be8-8b7bd21d36cb service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d&tenant_id=737743b16ec0418fb629805c6e0a1150 HTTP/1.1" status: 200 len: 1097 time: 0.0429847 Nov 15 12:52:52.792560 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-7da796af-8a92-41f9-8d62-d6114683be76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:52.794017 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-7da796af-8a92-41f9-8d62-d6114683be76 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1097 time: 0.0402300 Nov 15 12:52:52.885361 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-ce08f1fa-06d2-490b-b32d-7425aeef56da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:52.886904 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-ce08f1fa-06d2-490b-b32d-7425aeef56da service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.0846529 Nov 15 12:52:52.951321 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-54aa2a41-d93e-49aa-ac1e-ac77c8b41f2b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 999 time: 0.0566976 Nov 15 12:52:53.000511 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-360b3cc0-a076-475b-8a6c-d614fbb173dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:53.001919 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-360b3cc0-a076-475b-8a6c-d614fbb173dc service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0429156 Nov 15 12:52:53.051906 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-7f6d982e-be7e-4a0e-b533-82c5bf74228b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:53.053399 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-7f6d982e-be7e-4a0e-b533-82c5bf74228b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0436168 Nov 15 12:52:53.152440 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-453c96e0-91d5-49be-91c7-8921906263bf service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909512 Nov 15 12:52:53.249665 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-16034934-9e75-48e3-b6ec-d49fc8eb11f7 req-db176964-fa66-4948-aaff-b3c6518614fa service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892737 Nov 15 12:52:53.638722 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d6ea8b-d5d8-4083-be2c-38e2d050662f req-5ceb138b-272c-49c6-872e-b03ff6bbda49 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:53.640223 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d6d6ea8b-d5d8-4083-be2c-38e2d050662f req-5ceb138b-272c-49c6-872e-b03ff6bbda49 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0517030 Nov 15 12:52:53.692572 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-d6d6ea8b-d5d8-4083-be2c-38e2d050662f req-5fd63f4b-b7e7-41c1-adda-86386bfd2705 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433190 Nov 15 12:52:54.807730 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ee52d4-d4df-4dbd-9ba8-cdae6ac9d109 req-47fa6010-6233-4678-a4c5-899afa6b93a1 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:54.809172 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-89ee52d4-d4df-4dbd-9ba8-cdae6ac9d109 req-47fa6010-6233-4678-a4c5-899afa6b93a1 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0504334 Nov 15 12:52:54.856458 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-89ee52d4-d4df-4dbd-9ba8-cdae6ac9d109 req-5cb1b41c-91bc-4add-aa81-e70c231ac541 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413806 Nov 15 12:52:55.980677 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ad0ffe-bf8f-477f-b0e6-e277bb10baaf req-6bc826be-3160-4efc-9ab7-5d8613176685 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:55.982337 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-69ad0ffe-bf8f-477f-b0e6-e277bb10baaf req-6bc826be-3160-4efc-9ab7-5d8613176685 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0566103 Nov 15 12:52:56.053567 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-69ad0ffe-bf8f-477f-b0e6-e277bb10baaf req-d9ef7cd1-dbe6-4c48-b180-86ad9e018308 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652688 Nov 15 12:52:57.169166 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e4c3c75-7787-484e-a590-3605e167c527 req-4c1aff76-9f34-4006-bbbe-a7f57af49a7c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:57.170703 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0e4c3c75-7787-484e-a590-3605e167c527 req-4c1aff76-9f34-4006-bbbe-a7f57af49a7c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0495710 Nov 15 12:52:57.220107 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-0e4c3c75-7787-484e-a590-3605e167c527 req-65d34bcc-1b82-4541-8fd9-f2d400a65650 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434749 Nov 15 12:52:58.336244 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f6d8e9-dabd-450b-9a46-149a7b793c41 req-a9fd42a0-acdd-4a7d-92a6-d4b4c20e389c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:58.337703 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94f6d8e9-dabd-450b-9a46-149a7b793c41 req-a9fd42a0-acdd-4a7d-92a6-d4b4c20e389c tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0486805 Nov 15 12:52:58.386154 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-94f6d8e9-dabd-450b-9a46-149a7b793c41 req-c75b394d-d67c-4a8c-835e-df10d270da35 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426533 Nov 15 12:52:59.504189 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d247a6d6-574d-4390-8df1-b03559c58515 req-24daa2fa-e507-4aff-912f-fa877c5addc6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:52:59.505620 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d247a6d6-574d-4390-8df1-b03559c58515 req-24daa2fa-e507-4aff-912f-fa877c5addc6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0505044 Nov 15 12:52:59.553982 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-d247a6d6-574d-4390-8df1-b03559c58515 req-c2169ab4-387f-41fb-9a29-7be7cde8399e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425406 Nov 15 12:53:00.665841 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42df06d8-ec21-4e1e-99e8-3acab892378c req-747afb6f-627e-4562-bdad-de325b364ef1 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:00.667544 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-42df06d8-ec21-4e1e-99e8-3acab892378c req-747afb6f-627e-4562-bdad-de325b364ef1 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 944 time: 0.0466540 Nov 15 12:53:00.715005 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-42df06d8-ec21-4e1e-99e8-3acab892378c req-2c7de5c7-3baa-4c89-8499-7f4ceec02268 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414486 Nov 15 12:53:01.282012 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d details requested by agent hyperv_hv-cinder-80382 with host hv-cinder-80382 {{(pid=108288) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 15 12:53:01.376373 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:53:01.390352 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Returning: {'device': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'port_id': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'mac_address': 'fa:16:3e:7e:1f:82', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 617, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108288) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 15 12:53:01.426287 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:01.439254 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1991a6d-8d86-410a-837e-f95d619a3f1d {{(pid=108288) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 15 12:53:01.458285 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:53:01.462343 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:01.511490 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=7']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:53:01.785686 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] get_ports_and_sgs() called for port_ids ['e1991a6d-8d86-410a-837e-f95d619a3f1d'] {{(pid=108288) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 15 12:53:01.829968 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95ebe18-1d6e-4b66-a5ba-b06d0cd37305 req-a1a52e3e-a203-434e-9c2b-fef06612f525 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:01.831440 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b95ebe18-1d6e-4b66-a5ba-b06d0cd37305 req-a1a52e3e-a203-434e-9c2b-fef06612f525 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 945 time: 0.0479908 Nov 15 12:53:01.881165 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-b95ebe18-1d6e-4b66-a5ba-b06d0cd37305 req-17044545-821d-49c6-b3f6-243cf92f4086 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432527 Nov 15 12:53:02.997886 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83286a60-422d-4d5b-a86b-b0781a0a239a req-c53dc8fa-486b-406f-8842-dbc873aab723 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:02.999311 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-83286a60-422d-4d5b-a86b-b0781a0a239a req-c53dc8fa-486b-406f-8842-dbc873aab723 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 945 time: 0.0508277 Nov 15 12:53:03.047889 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-83286a60-422d-4d5b-a86b-b0781a0a239a req-637482d7-5c5b-45fc-9184-3f5f4f0a1975 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426884 Nov 15 12:53:03.293456 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d up at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 15 12:53:03.350514 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2a303d18-cb4f-41a5-a12c-9137df64272f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:03.357209 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.provisioning_blocks [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Provisioning complete for port e1991a6d-8d86-410a-837e-f95d619a3f1d triggered by entity L2. {{(pid=108288) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 15 12:53:03.357569 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-529099'] for port, provisioning_complete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:03.430886 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-660485'] for port, before_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:03.451897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108288) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:53:03.454128 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94d44c3d6ea8f22e2f0b5d581dcee8dcf2e7bae7ab0b03b6fc152fbe03aa2dca" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-701528d7-1b30-41f4-8157-472fcd9eb75d" -d '{"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-plugged", "status": "completed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108288) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:53:03.467799 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:53:03.471939 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738060695983', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738060186040', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738060186058'] for port, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:03.499506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:53:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6fb3624b-611d-465e-8d56-ab6b5011b9dc x-openstack-request-id: req-6fb3624b-611d-465e-8d56-ab6b5011b9dc {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:53:03.499792 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-plugged", "status": "completed", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "code": 200}]} {{(pid=108288) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:53:03.500038 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-6fb3624b-611d-465e-8d56-ab6b5011b9dc {{(pid=108288) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:53:03.500453 dv-cinder-803823-7-iscsi neutron-server[108288]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'code': 200} Nov 15 12:53:03.525523 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Pushing event updated for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=8']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:53:03.753793 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778580a4-4150-43e4-af09-9f215f551f5d req-aaf8d339-254f-4b00-83f7-8d46fb3b5a05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:03.755242 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-778580a4-4150-43e4-af09-9f215f551f5d req-aaf8d339-254f-4b00-83f7-8d46fb3b5a05 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.0384152 Nov 15 12:53:03.801645 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-778580a4-4150-43e4-af09-9f215f551f5d req-fedd2f19-db8c-4a37-aabf-41fc8bb5bf10 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381186 Nov 15 12:53:04.165904 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f788b90-e360-4955-a0b8-1fb1f53c750e req-508721c9-4776-4b03-9469-ba354b48f6d4 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:04.167630 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3f788b90-e360-4955-a0b8-1fb1f53c750e req-508721c9-4776-4b03-9469-ba354b48f6d4 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0505326 Nov 15 12:53:04.221083 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-3f788b90-e360-4955-a0b8-1fb1f53c750e req-bb0a501e-1866-4b52-929c-210021764cf9 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476050 Nov 15 12:53:05.337376 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5ef96f-a18a-49fe-8610-d6e19761b153 req-f82b371d-7e4d-4541-9c7b-deb627260b23 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:05.338815 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef5ef96f-a18a-49fe-8610-d6e19761b153 req-f82b371d-7e4d-4541-9c7b-deb627260b23 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0506775 Nov 15 12:53:05.389881 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-ef5ef96f-a18a-49fe-8610-d6e19761b153 req-1ef7df4e-3fc9-4514-93a2-00c822afe361 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450227 Nov 15 12:53:05.803244 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1680347a-6d38-4556-ba42-fd7f70f7d141 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:06.910182 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:08.371418 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:09.156827 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:13.776208 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:53:14.189223 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:33.342404 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3c32caa3-7b89-4190-ac67-4c22d92aa16e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:35.805774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f7064d86-1f8f-4ba9-9303-ac11b76eeb5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:36.913378 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:38.424468 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:39.159726 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:44.188871 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:53:50.776053 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:53:53.346502 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-955cb857-1f85-4f6b-998d-e4c7582acdff service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387924 Nov 15 12:53:53.445175 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-0e46936e-6f69-4d30-8674-dc87cf13f628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:53.447270 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-0e46936e-6f69-4d30-8674-dc87cf13f628 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.0417793 Nov 15 12:53:53.551525 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-f9bbfc35-d836-4119-a62e-6c628fc91619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:53.553057 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-f9bbfc35-d836-4119-a62e-6c628fc91619 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.0860224 Nov 15 12:53:53.616503 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-8e1d3f5c-d722-4b32-98f6-82486c578235 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 1001 time: 0.0553720 Nov 15 12:53:53.664982 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-db28894a-55c1-4311-9863-d144cc8e6e82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:53.666441 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-db28894a-55c1-4311-9863-d144cc8e6e82 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0423765 Nov 15 12:53:53.716606 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-5aed4543-d6f2-434f-850b-897209ad78ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:53:53.718115 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-5aed4543-d6f2-434f-850b-897209ad78ef service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439281 Nov 15 12:53:53.806981 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-46c6a423-89fc-4bfc-83ce-23d8e2f92a47 service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807092 Nov 15 12:53:53.899759 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-013d0a0c-c99d-4b5f-a35c-f8ab9a1ab22f req-c36c4902-35bb-4d7c-b850-4205eb8ae88f service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843787 Nov 15 12:54:03.343625 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7d30c9fe-0d1f-4cea-9dd3-6b9190bde519 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:05.806336 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e9773ffa-f904-450c-9ddb-c7aaa9f4f766 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:06.918809 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:08.378542 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:09.161363 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:14.200203 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:20.923377 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58660) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:21.076843 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Deleting port b6cffc50-b40e-4680-a242-4a6dbba95e79 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:21.077343 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.151561 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.151888 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.163579 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Calling delete_port for b6cffc50-b40e-4680-a242-4a6dbba95e79 owned by network:floatingip {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:21.306022 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.332453 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event deleted for resources: {'Port': ['ID=b6cffc50-b40e-4680-a242-4a6dbba95e79,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:21.359252 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.359590 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.359926 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.360285 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.360644 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.360973 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.361294 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.361614 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.361936 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.362253 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.362570 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.362883 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108287) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:21.400461 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for floatingip, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.400784 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.db.l3_db [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Floating IP d0c257b5-236c-46a6-b58c-18ef9653a7fe disassociated (deleted). External IP: 172.27.0.86, port: e1991a6d-8d86-410a-837e-f95d619a3f1d. Nov 15 12:54:21.867222 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:54:21.968682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:54:21.972923 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for floatingip, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:21.978267 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Sync routers for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:54:21.987981 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:21.988606 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:21.999948 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1a03062a-878e-4ae9-9285-0719d1c13a46 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "DELETE /v2.0/floatingips/d0c257b5-236c-46a6-b58c-18ef9653a7fe HTTP/1.1" status: 204 len: 168 time: 1.0752068 Nov 15 12:54:22.000654 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108287) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:54:22.002915 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4084027a11211d6c100b729cfd28e2769e776a70ed2ebc7962610145e0e5f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-465762d2-9ccb-4e70-8bb3-176883ee1129" -d '{"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108287) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:54:22.048752 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 15 Nov 2021 12:54:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78c5b413-86f4-44cc-96a4-46b5ca5b2a80 x-openstack-request-id: req-78c5b413-86f4-44cc-96a4-46b5ca5b2a80 {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:54:22.049051 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "status": "completed", "code": 200}]} {{(pid=108287) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:54:22.049350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-78c5b413-86f4-44cc-96a4-46b5ca5b2a80 {{(pid=108287) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:54:22.049694 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'status': 'completed', 'code': 200} Nov 15 12:54:22.145533 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-c1bbf998-cf17-4b77-a34e-71383b6a28b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:22.147075 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-c1bbf998-cf17-4b77-a34e-71383b6a28b5 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=737743b16ec0418fb629805c6e0a1150&device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 1099 time: 0.0436649 Nov 15 12:54:22.216423 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:22.241380 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-77902aaa-39bf-47ff-9faa-d636a11474a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:22.242840 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-77902aaa-39bf-47ff-9faa-d636a11474a9 service neutron] 10.222.0.61 "GET /v2.0/networks?id=4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 200 len: 908 time: 0.0879033 Nov 15 12:54:22.286095 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-0bd13ccb-5d9b-41de-ae42-e15d94a348a0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 200 len: 217 time: 0.0331120 Nov 15 12:54:22.335499 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-9c8a385d-e350-4696-9ce7-9601e87736d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:22.336956 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-9c8a385d-e350-4696-9ce7-9601e87736d4 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 200 len: 846 time: 0.0433662 Nov 15 12:54:22.387554 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-2dd6a157-d3e8-45f0-a178-1f9b34ffec8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:22.389091 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-2dd6a157-d3e8-45f0-a178-1f9b34ffec8d service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=4df1794c-df61-4e22-9f30-ef1b263e82e8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432286 Nov 15 12:54:22.411143 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:22.437165 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Checking router: b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:54:22.445127 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:22.445711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:22.479140 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-3b98eed0-1123-4256-9c35-2620d0514f6c service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821590 Nov 15 12:54:22.552207 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:22.573935 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-465762d2-9ccb-4e70-8bb3-176883ee1129 req-e78a7b4f-518c-42ca-b3c6-7e368fb93dab service neutron] 10.222.0.61 "GET /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858865 Nov 15 12:54:22.750218 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:22.780278 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09b31278-4114-4064-906f-7a0599f41dc9 None None] The sync data for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi is: [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:37Z', 'revision_number': 4, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi', '_interfaces': [{'id': '57dd8865-1107-4d65-b9ac-337a02de9bca', 'name': '', 'network_id': '4df1794c-df61-4e22-9f30-ef1b263e82e8', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'mac_address': 'fa:16:3e:6a:d9:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_interface', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:37Z', 'updated_at': '2021-11-15T12:49:42Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'subnets': [{'id': '7f869a7a-ae34-40e6-a819-d5a2784495c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:54:22.987658 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f6780bf-a4cb-464f-a59d-131a3985ef09 None None] New status for floating IP d0c257b5-236c-46a6-b58c-18ef9653a7fe: DOWN {{(pid=108289) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 15 12:54:23.251350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacf7bb0-23f1-44d9-9178-d8fe264b8428 req-df5a80c2-fc6f-4158-8b4e-ae4795a2e191 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108287) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:23.252945 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dacf7bb0-23f1-44d9-9178-d8fe264b8428 req-df5a80c2-fc6f-4158-8b4e-ae4795a2e191 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0531061 Nov 15 12:54:23.304086 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [req-dacf7bb0-23f1-44d9-9178-d8fe264b8428 req-d48f1681-c9e7-46fb-9f4b-15d383e76b41 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441585 Nov 15 12:54:24.433746 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97bb615-449f-4eb2-aa65-aeb1a2bf9eea req-f146e6e0-5117-41d2-902a-704d625f3234 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:24.435256 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a97bb615-449f-4eb2-aa65-aeb1a2bf9eea req-f146e6e0-5117-41d2-902a-704d625f3234 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0559454 Nov 15 12:54:24.502926 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-a97bb615-449f-4eb2-aa65-aeb1a2bf9eea req-0258e27b-7067-4e56-afef-5a0c0eca6637 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/security-groups?id=3597f45e-b04d-41cd-a10a-420b69e29085&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611701 Nov 15 12:54:24.943629 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-3c76bcb7-9c97-4fb5-9371-61906aabff08 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108286) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 15 12:54:24.945095 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-3c76bcb7-9c97-4fb5-9371-61906aabff08 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.61 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 946 time: 0.0473678 Nov 15 12:54:25.036233 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Deleting port e1991a6d-8d86-410a-837e-f95d619a3f1d {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:25.036567 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:25.122567 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] For port e1991a6d-8d86-410a-837e-f95d619a3f1d, host hv-cinder-80382, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80382',level=0,port_id=e1991a6d-8d86-410a-837e-f95d619a3f1d,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:25.122922 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:25.139127 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Calling delete_port for e1991a6d-8d86-410a-837e-f95d619a3f1d owned by compute:nova {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:25.261181 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:25.293641 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event deleted for resources: {'Port': ['ID=e1991a6d-8d86-410a-837e-f95d619a3f1d,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:25.323543 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.323884 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.324245 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.324574 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.324895 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.325215 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.325535 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.325859 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.326171 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.326487 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.326801 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.327114 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108286) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:25.348514 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.l3_dvrscheduler_db [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] No DVR routers for this DVR port e1991a6d-8d86-410a-837e-f95d619a3f1d on host hv-cinder-80382 {{(pid=108286) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:54:25.351044 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-148501'] for port, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:25.354942 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-4fc9233e-0348-4e85-95cc-fced7286aecd req-b38d8c7a-b80b-4330-ab98-ab5cd5438e3d tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.61 "DELETE /v2.0/ports/e1991a6d-8d86-410a-837e-f95d619a3f1d HTTP/1.1" status: 204 len: 173 time: 0.4019363 Nov 15 12:54:25.355408 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-deleted', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d'}] {{(pid=108286) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 15 12:54:25.357871 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.44/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}061b499f2c03a54a895ed28518996e8916f41a81d38e7ea6d1d747af0eb9b15b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c95e858-479e-4ecd-b5fc-f9bec9a53ed8" -d '{"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-deleted", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d"}]}' {{(pid=108286) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 15 12:54:25.407567 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 15 Nov 2021 12:54:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30a9ea7b-2656-4ea5-800e-80a8b8a940c4 x-openstack-request-id: req-30a9ea7b-2656-4ea5-800e-80a8b8a940c4 {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 15 12:54:25.408210 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcc809fb-0a29-45c5-b429-f6a286eb2b6d", "name": "network-vif-deleted", "tag": "e1991a6d-8d86-410a-837e-f95d619a3f1d", "status": "completed", "code": 200}]} {{(pid=108286) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 15 12:54:25.408472 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.44/compute/v2.1/os-server-external-events used request id req-30a9ea7b-2656-4ea5-800e-80a8b8a940c4 {{(pid=108286) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 15 12:54:25.408870 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bcc809fb-0a29-45c5-b429-f6a286eb2b6d', 'name': 'network-vif-deleted', 'tag': 'e1991a6d-8d86-410a-837e-f95d619a3f1d', 'status': 'completed', 'code': 200} Nov 15 12:54:25.599832 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [req-c0d14f66-75a2-4c6d-8eb6-79c30bdb3d62 req-3354b853-6947-4510-a06e-74561cf809d6 tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "GET /v2.0/ports?device_id=bcc809fb-0a29-45c5-b429-f6a286eb2b6d HTTP/1.1" status: 200 len: 210 time: 0.0269189 Nov 15 12:54:26.655366 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58688) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:26.711510 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:26.735331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:26.792217 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:26.795042 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:26.796180 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] 10.222.0.44 "DELETE /v2.0/security-groups/3597f45e-b04d-41cd-a10a-420b69e29085 HTTP/1.1" status: 204 len: 168 time: 0.1398287 Nov 15 12:54:26.805379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248e9147-abfe-4f0f-94a1-ad0e373ea62e tempest-TestShelveInstance-854945110 tempest-TestShelveInstance-854945110-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3597f45e-b04d-41cd-a10a-420b69e29085,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:27.775373 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:54:27.863080 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58694) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:28.450957 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:28.680951 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Deleting port 57dd8865-1107-4d65-b9ac-337a02de9bca {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:28.681288 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:28.759037 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] For port 57dd8865-1107-4d65-b9ac-337a02de9bca, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=57dd8865-1107-4d65-b9ac-337a02de9bca,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:28.759396 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:28.771753 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Calling delete_port for 57dd8865-1107-4d65-b9ac-337a02de9bca owned by network:router_interface {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:28.947969 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:28.975886 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Pushing event deleted for resources: {'Port': ['ID=57dd8865-1107-4d65-b9ac-337a02de9bca,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:29.147521 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.359853 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108286) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:54:29.464253 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108286) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:54:29.469305 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-42d9aaf4-a7fa-4243-9a78-5bebe2a78de1 admin admin] 10.222.0.44 "PUT /v2.0/routers/b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6046374 Nov 15 12:54:29.471601 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58696) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:29.474309 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Sync routers for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:54:29.484820 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:29.485420 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:29.573976 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks [] for router, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.586945 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:29.676475 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.727786 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Deleting port a09cf961-3d95-4d4f-ba34-32e4ee4f826b {{(pid=108286) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:29.728144 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.748407 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d no longer exists at agent hyperv_hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:29.773945 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] No Port match for: e1991a6d-8d86-410a-837e-f95d619a3f1d {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:29.774269 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Device e1991a6d-8d86-410a-837e-f95d619a3f1d not bound to the agent host hv-cinder-80382 {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:29.790619 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:54:28Z', 'revision_number': 5, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port': {'id': 'a09cf961-3d95-4d4f-ba34-32e4ee4f826b', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:9f:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:49:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:29.816605 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.db [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] For port a09cf961-3d95-4d4f-ba34-32e4ee4f826b, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108286) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:29.816967 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.819070 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Checking router: b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 for host: dv-cinder-803823-7-iscsi {{(pid=108288) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:54:29.828272 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Routers {'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108288) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:29.828813 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.plugins.ml2.plugin [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Calling delete_port for a09cf961-3d95-4d4f-ba34-32e4ee4f826b owned by network:router_gateway {{(pid=108286) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:29.828985 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'], 'active': True} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:29.912793 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvr_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] Set router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 gateway port host: None {{(pid=108288) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:29.966382 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_hamode_db [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:54:29Z', 'revision_number': 6, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108288) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:29.991435 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-30644499'] for port, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:29.993580 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ffe3a2-6857-40af-a076-3251af269280 None None] The sync data for ids ['b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9'] in dv-cinder-803823-7-iscsi is: [{'id': 'b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9', 'name': 'tempest-TestShelveInstance-69828109-router', 'tenant_id': '737743b16ec0418fb629805c6e0a1150', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:34Z', 'updated_at': '2021-11-15T12:54:29Z', 'revision_number': 6, 'project_id': '737743b16ec0418fb629805c6e0a1150', 'gw_port_host': None}] {{(pid=108288) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:54:30.018711 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Pushing event deleted for resources: {'Port': ['ID=a09cf961-3d95-4d4f-ba34-32e4ee4f826b,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:30.079523 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.167843 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.169965 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.213138 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.214328 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 {{(pid=108286) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:54:30.219896 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] Publish callbacks [] for router, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.221283 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-9155ee81-1fdd-49c9-8c59-b20ba8df93b1 admin admin] 10.222.0.44 "DELETE /v2.0/routers/b3f84d73-6ebb-4b4e-8d7e-eb88747b83a9 HTTP/1.1" status: 204 len: 168 time: 0.7487159 Nov 15 12:54:30.223689 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [-] (108286) accepted ('10.222.0.44', 58698) {{(pid=108286) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:30.266410 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.db.db_base_plugin_v2 [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Deleting subnet 7f869a7a-ae34-40e6-a819-d5a2784495c3 {{(pid=108286) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:54:30.269302 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.302675 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30503377'] for subnet, precommit_delete_associations {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.384644 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.440542 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-30644734', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30196501'] for subnet, after_delete {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.467267 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7f869a7a-ae34-40e6-a819-d5a2784495c3,revision_number=None']} {{(pid=108286) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:30.469258 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron_lib.callbacks.manager [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for subnet, before_response {{(pid=108286) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.472411 dv-cinder-803823-7-iscsi neutron-server[108286]: INFO neutron.wsgi [None req-4f0e94c5-a9bb-4931-a45b-7b292f407b96 admin admin] 10.222.0.44 "DELETE /v2.0/subnets/7f869a7a-ae34-40e6-a819-d5a2784495c3 HTTP/1.1" status: 204 len: 168 time: 0.2477369 Nov 15 12:54:30.474387 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c029156-1cf3-49d7-9820-f830ebb09094 None None] Network 4df1794c-df61-4e22-9f30-ef1b263e82e8 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:54:30.475363 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58700) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:30.544895 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.595589 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Deleting port 1907cda8-e82d-424a-ac3a-fd0ebe632558 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:30.595799 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.661112 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] For port 1907cda8-e82d-424a-ac3a-fd0ebe632558, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=1907cda8-e82d-424a-ac3a-fd0ebe632558,segment=NetworkSegment(8a8142da-1d36-489e-be0d-5441b680bb36),segment_id=8a8142da-1d36-489e-be0d-5441b680bb36)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:30.661469 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.673528 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Calling delete_port for 1907cda8-e82d-424a-ac3a-fd0ebe632558 owned by network:dhcp {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:30.748939 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-613f3a20-7a9b-4314-ae2f-6ba0ddda944f None None] DHCP port deletion for 4df1794c-df61-4e22-9f30-ef1b263e82e8 request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:54:30.751772 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.782096 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] No DVR routers for this DVR port 1907cda8-e82d-424a-ac3a-fd0ebe632558 on host dv-cinder-803823-7-iscsi {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:54:30.786268 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Pushing event deleted for resources: {'Port': ['ID=1907cda8-e82d-424a-ac3a-fd0ebe632558,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:30.860676 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.880355 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4df1794c-df61-4e22-9f30-ef1b263e82e8']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:30.889932 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8a8142da-1d36-489e-be0d-5441b680bb36') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:30.890227 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8a8142da-1d36-489e-be0d-5441b680bb36') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:30.899644 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.913220 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.920540 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Releasing vlan 617 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:54:30.920953 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:54:30.922784 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:54:30.981597 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.986726 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:30.990282 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] 10.222.0.44 "DELETE /v2.0/networks/4df1794c-df61-4e22-9f30-ef1b263e82e8 HTTP/1.1" status: 204 len: 168 time: 0.5138621 Nov 15 12:54:30.993522 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58702) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:31.002517 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 57dd8865-1107-4d65-b9ac-337a02de9bca no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:31.017399 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683e9e29-bf97-48b7-8d04-b7967bfad5a9 admin admin] Pushing event deleted for resources: {'Network': ['ID=4df1794c-df61-4e22-9f30-ef1b263e82e8,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:31.025186 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 57dd8865-1107-4d65-b9ac-337a02de9bca {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:31.025774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 57dd8865-1107-4d65-b9ac-337a02de9bca not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:31.026285 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device a09cf961-3d95-4d4f-ba34-32e4ee4f826b no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:31.046321 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: a09cf961-3d95-4d4f-ba34-32e4ee4f826b {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:31.046750 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device a09cf961-3d95-4d4f-ba34-32e4ee4f826b not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:31.047158 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1907cda8-e82d-424a-ac3a-fd0ebe632558 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:31.066581 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 1907cda8-e82d-424a-ac3a-fd0ebe632558 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:31.066837 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 1907cda8-e82d-424a-ac3a-fd0ebe632558 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:31.345756 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-33077695'] for router_interface, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:31.579455 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Deleting port 2cab7388-9f52-48c2-9fc7-0e83712e1295 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:31.580164 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:31.655937 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] For port 2cab7388-9f52-48c2-9fc7-0e83712e1295, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=2cab7388-9f52-48c2-9fc7-0e83712e1295,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:31.656240 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:31.668275 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Calling delete_port for 2cab7388-9f52-48c2-9fc7-0e83712e1295 owned by network:router_interface {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:31.843067 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:31.872292 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Pushing event deleted for resources: {'Port': ['ID=2cab7388-9f52-48c2-9fc7-0e83712e1295,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:32.035230 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-33035323', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-33077707'] for router_interface, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.242201 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Router b4807293-44a0-4ef8-acbc-ef880e57fb07 has already been hosted by L3 agent 13720fee-8724-496a-9f8b-d39cd42c8632 {{(pid=108287) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 15 12:54:32.343172 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] Notify agent at l3_agent.dv-cinder-803823-7-iscsi the message routers_updated {{(pid=108287) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 15 12:54:32.348082 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-f0a6926f-b119-4cd1-a434-64bf2cc02ebe admin admin] 10.222.0.44 "PUT /v2.0/routers/b4807293-44a0-4ef8-acbc-ef880e57fb07/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3533547 Nov 15 12:54:32.350639 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58704) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:32.351515 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Sync routers for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 15 12:54:32.361732 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:32.362322 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:32.448543 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks [] for router, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.461723 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: dv-cinder-803823-7-iscsi {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:32.547393 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.601384 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Deleting port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:32.602088 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.637255 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'external_fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244'}], 'enable_snat': True}, 'gw_port_id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:54:31Z', 'revision_number': 5, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port': {'id': '27b0a8d2-823c-4f77-9f4f-55dbe2d10b77', 'name': '', 'network_id': '45831433-abc0-4e27-bccd-5aeb94543032', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:8a:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'ip_address': '172.27.0.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803823-7-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-15T12:49:40Z', 'updated_at': '2021-11-15T12:49:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f0a0a193-a36f-4db1-9bc0-b984b6129445', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803823-7-iscsi'}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:32.663259 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Checking router: b4807293-44a0-4ef8-acbc-ef880e57fb07 for host: dv-cinder-803823-7-iscsi {{(pid=108289) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 15 12:54:32.671513 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvrscheduler_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Routers {'b4807293-44a0-4ef8-acbc-ef880e57fb07'} bound to L3 agent in host dv-cinder-803823-7-iscsi {{(pid=108289) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 15 12:54:32.672098 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803823-7-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-15T12:31:36Z,description=,heartbeat_timestamp=2021-11-15T12:54:06Z,host='dv-cinder-803823-7-iscsi',id=13720fee-8724-496a-9f8b-d39cd42c8632,load=0,resource_versions=,resources_synced=,started_at=2021-11-15T12:31:36Z,topic='l3_agent')) {'router_ids': ['b4807293-44a0-4ef8-acbc-ef880e57fb07'], 'active': True} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:32.678583 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] For port 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,segment=NetworkSegment(bf382968-1d0a-45d6-a42c-25204c795036),segment_id=bf382968-1d0a-45d6-a42c-25204c795036)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:32.678948 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.690967 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Calling delete_port for 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 owned by network:router_gateway {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:32.754045 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_dvr_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] Set router b4807293-44a0-4ef8-acbc-ef880e57fb07 gateway port host: None {{(pid=108289) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 15 12:54:32.803856 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.l3_hamode_db [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:54:32Z', 'revision_number': 6, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port_host': None}], 'dv-cinder-803823-7-iscsi', False) {} {{(pid=108289) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:32.832679 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-accebad0-ca84-411b-b25c-8c133af863e8 None None] The sync data for ids ['b4807293-44a0-4ef8-acbc-ef880e57fb07'] in dv-cinder-803823-7-iscsi is: [{'id': 'b4807293-44a0-4ef8-acbc-ef880e57fb07', 'name': 'tempest-TestShelveInstance-452173356-router', 'tenant_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-15T12:49:39Z', 'updated_at': '2021-11-15T12:54:32Z', 'revision_number': 6, 'project_id': '88eeddbaa7bc444a9e28c3f51d3babc5', 'gw_port_host': None}] {{(pid=108289) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 15 12:54:32.852132 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:32.877500 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Pushing event deleted for resources: {'Port': ['ID=27b0a8d2-823c-4f77-9f4f-55dbe2d10b77,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:32.945763 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-33113201'] for router_gateway, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.032867 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-33079187', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-998'] for router, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.034875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.077304 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-33079178'] for router, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.077969 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Fanout notify agent at l3_agent the message router_deleted on router b4807293-44a0-4ef8-acbc-ef880e57fb07 {{(pid=108287) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 15 12:54:33.082168 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] Publish callbacks [] for router, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.083310 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-73a35e91-105a-4c11-bbd5-93e89bc6bc6a admin admin] 10.222.0.44 "DELETE /v2.0/routers/b4807293-44a0-4ef8-acbc-ef880e57fb07 HTTP/1.1" status: 204 len: 168 time: 0.7317603 Nov 15 12:54:33.085875 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58706) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:33.138349 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.db_base_plugin_v2 [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Deleting subnet ad44d629-bfd7-47f4-af4d-983aaf3cd6fb {{(pid=108287) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 15 12:54:33.141335 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.177779 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-30429058'] for subnet, precommit_delete_associations {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.269633 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-526301'] for subnet, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.291394 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 2cab7388-9f52-48c2-9fc7-0e83712e1295 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:33.315925 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 2cab7388-9f52-48c2-9fc7-0e83712e1295 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:33.316315 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 2cab7388-9f52-48c2-9fc7-0e83712e1295 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:33.330285 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-526292', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33247901', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29998970', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-30113311'] for subnet, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.346166 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-46b8a9e6-9499-424a-9418-9bccda80d795 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.355376 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ad44d629-bfd7-47f4-af4d-983aaf3cd6fb,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:33.360944 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] Publish callbacks [] for subnet, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.364086 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-d40d77b3-7afa-44e6-81dc-5633e4f83bed admin admin] 10.222.0.44 "DELETE /v2.0/subnets/ad44d629-bfd7-47f4-af4d-983aaf3cd6fb HTTP/1.1" status: 204 len: 168 time: 0.2772813 Nov 15 12:54:33.365924 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20324a1f-6079-49f0-ac91-d7df6734f1a7 None None] Network e02c02f2-7d49-44a7-8377-48dd11f6cf87 requested from dv-cinder-803823-7-iscsi {{(pid=108288) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 15 12:54:33.366588 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58708) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:33.442648 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-32830106'] for network, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.499715 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Deleting port c118a972-869b-44a3-a205-7bcb7dfe7fc4 {{(pid=108287) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:33.500054 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.564537 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.db [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] For port c118a972-869b-44a3-a205-7bcb7dfe7fc4, host dv-cinder-803823-7-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803823-7-iscsi',level=0,port_id=c118a972-869b-44a3-a205-7bcb7dfe7fc4,segment=NetworkSegment(2c2f3ea3-130b-4d98-8e91-7c36736c18f0),segment_id=2c2f3ea3-130b-4d98-8e91-7c36736c18f0)] {{(pid=108287) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:33.564777 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.577518 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.plugin [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Calling delete_port for c118a972-869b-44a3-a205-7bcb7dfe7fc4 owned by network:dhcp {{(pid=108287) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:33.621674 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] DHCP port deletion for e02c02f2-7d49-44a7-8377-48dd11f6cf87 request from dv-cinder-803823-7-iscsi {{(pid=108288) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 15 12:54:33.664307 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29998999'] for port, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.673043 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Deleting port c118a972-869b-44a3-a205-7bcb7dfe7fc4 {{(pid=108288) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 15 12:54:33.673485 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738060608467'] for port, before_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.690350 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Pushing event deleted for resources: {'Port': ['ID=c118a972-869b-44a3-a205-7bcb7dfe7fc4,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:33.692160 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] No DVR routers for this DVR port c118a972-869b-44a3-a205-7bcb7dfe7fc4 on host dv-cinder-803823-7-iscsi {{(pid=108287) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:54:33.743111 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.db [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] For port c118a972-869b-44a3-a205-7bcb7dfe7fc4, host dv-cinder-803823-7-iscsi, got binding levels [] {{(pid=108288) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 15 12:54:33.743520 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-33117413'] for port, precommit_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.760341 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Calling delete_port for c118a972-869b-44a3-a205-7bcb7dfe7fc4 owned by network:dhcp {{(pid=108288) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 15 12:54:33.763777 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.ipam_backend_mixin [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Port c118a972-869b-44a3-a205-7bcb7dfe7fc4 was not found and therefore no delete operation was performed {{(pid=108288) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 15 12:54:33.765023 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-660674', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33553236', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738060695965', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738060186031'] for port, after_delete {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.771147 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-531012', 'neutron.services.segments.db._delete_segments_for_network-8738060767178'] for network, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.789576 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Pushing event deleted for resources: {'Port': ['ID=c118a972-869b-44a3-a205-7bcb7dfe7fc4,revision_number=None']} {{(pid=108288) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:33.792236 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e02c02f2-7d49-44a7-8377-48dd11f6cf87']}} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:33.795887 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] No DVR routers for this DVR port c118a972-869b-44a3-a205-7bcb7dfe7fc4 on host dv-cinder-803823-7-iscsi {{(pid=108288) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 15 12:54:33.803207 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2c2f3ea3-130b-4d98-8e91-7c36736c18f0') {'for_net_delete': True} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:33.803500 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.services.segments.db [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2c2f3ea3-130b-4d98-8e91-7c36736c18f0') {} {{(pid=108287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 15 12:54:33.806534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.807066 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.808237 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.808756 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.809263 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.809774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.810583 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.810812 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.811148 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.811624 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.812136 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.812940 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b75db52-f198-4eca-8e5e-5bcd9c122afb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803823-7-iscsi {{(pid=108288) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 15 12:54:33.814855 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738060773075', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-30429115'] for segment, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.829547 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364'] for segment, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.836052 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Releasing vlan 644 on physical network physnet1 to pool {{(pid=108287) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 15 12:54:33.836472 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-526364', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29999040'] for segment, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: Traceback (most recent call last): Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: timer() Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: cb(*args, **kw) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: return func(*args, **kwargs) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: self._notify() Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: self.callback(batched_events) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: event.method(event) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: aggregate_uuid = self.p_client.list_aggregates( Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: return f(self, *a, **k) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._get(url).json() Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: return self.request(url, 'GET', **kwargs) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: base_url = self.get_endpoint(auth, allow=allow, Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 15 12:54:33.838075 dv-cinder-803823-7-iscsi neutron-server[108287]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 15 12:54:33.896682 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-531039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33092042', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-33035264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-33113173'] for network, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.902092 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-33035294'] for network, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:33.907669 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] 10.222.0.44 "DELETE /v2.0/networks/e02c02f2-7d49-44a7-8377-48dd11f6cf87 HTTP/1.1" status: 204 len: 168 time: 0.5376754 Nov 15 12:54:33.921658 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1bb7435-a76f-4dbc-aa1b-a52601602da8 admin admin] Pushing event deleted for resources: {'Network': ['ID=e02c02f2-7d49-44a7-8377-48dd11f6cf87,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:34.094754 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58712) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:34.275451 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-1c4f207f-06c8-4a3b-82c8-bbb5728f2031 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=737743b16ec0418fb629805c6e0a1150&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1795628 Nov 15 12:54:34.278135 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58716) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:34.324331 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.344028 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.388060 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.390582 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.391702 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/c056b79c-3b45-43c0-9c65-79b4a2f4c688 HTTP/1.1" status: 204 len: 168 time: 0.1124320 Nov 15 12:54:34.400694 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6936af5b-6f19-4318-96e8-6d3173409b1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c056b79c-3b45-43c0-9c65-79b4a2f4c688,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:34.648659 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58722) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:34.687027 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-c44b1d92-f2e2-4448-8482-95a83aa22396 admin admin] 10.222.0.44 "GET /v2.0/security-groups?tenant_id=88eeddbaa7bc444a9e28c3f51d3babc5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0372050 Nov 15 12:54:34.689379 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [-] (108287) accepted ('10.222.0.44', 58724) {{(pid=108287) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 15 12:54:34.736892 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.756532 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.801204 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-33091961'] for security_group, after_delete {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.803697 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron_lib.callbacks.manager [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:34.804856 dv-cinder-803823-7-iscsi neutron-server[108287]: INFO neutron.wsgi [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] 10.222.0.44 "DELETE /v2.0/security-groups/ef55c1b6-9fb2-45b3-a513-6e110dba713f HTTP/1.1" status: 204 len: 168 time: 0.1146150 Nov 15 12:54:34.812469 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880fa20e-17a9-4df7-a6e0-9ceb4c68852f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef55c1b6-9fb2-45b3-a513-6e110dba713f,revision_number=None']} {{(pid=108287) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 15 12:54:35.000010 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:35.022397 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:35.023071 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device 27b0a8d2-823c-4f77-9f4f-55dbe2d10b77 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:35.023823 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c118a972-869b-44a3-a205-7bcb7dfe7fc4 no longer exists at agent ovs-agent-dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 15 12:54:35.046439 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.plugin [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] No Port match for: c118a972-869b-44a3-a205-7bcb7dfe7fc4 {{(pid=108288) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 15 12:54:35.046862 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron.plugins.ml2.rpc [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Device c118a972-869b-44a3-a205-7bcb7dfe7fc4 not bound to the agent host dv-cinder-803823-7-iscsi {{(pid=108288) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 15 12:54:35.809523 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2bda1c76-476c-4d6c-9d95-b56b6035ada1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:36.918512 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:38.380916 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:39.162549 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:54:44.233830 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:03.349469 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f7a4a5d0-ff1c-4b9e-942e-150b742af797 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:04.774786 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:55:05.811839 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-e7abfe71-08a8-4176-b1ce-14db3baa6bbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:06.923007 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:08.384554 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:09.167944 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:14.235356 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:33.350892 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3c33b191-9d5d-4e5c-ab02-7f8938682f2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:35.814086 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-114764b9-d3b0-4675-8500-a50215fadf21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:36.923711 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:38.428239 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:39.162506 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:55:41.774774 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:55:44.249572 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:03.350774 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-bbd4a39c-1e92-4b3f-bc13-02649095adb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:05.815275 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-8fcf7f5c-40da-49a0-8d4d-8ea63c9d36f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:06.927736 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:08.389536 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:09.165284 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:14.263651 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:18.773504 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:56:33.351897 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d8368328-98d9-41bd-9c92-418afcef2627 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:35.816687 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4b84a264-baf7-4214-970c-cd6db78fe1b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:36.934636 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:38.392831 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:39.168326 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:44.277931 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:56:55.772401 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:57:03.353325 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-a7342501-9205-4ed1-a032-20d33b1ab7fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:05.817769 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-3a2bcb71-c70e-4af8-bf11-ade51af2f06b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:06.934424 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:08.395483 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:09.170318 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:14.293476 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:32.770777 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:57:33.357603 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-76bab4ff-a21d-48c1-81e6-4e58a180da1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:35.820016 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-2b83106f-18f0-40a2-be18-e0b36f7753d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:36.935831 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:38.432760 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:39.173064 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:57:44.293563 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:03.359037 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c701a55-86ef-4a06-b2d3-24f58878295d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:05.821844 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-899b3b42-4e46-4e4d-b6b0-c8d6a6c518e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:06.941306 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:08.401534 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:09.175100 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:09.769486 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:58:14.308355 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:33.361549 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-89193ad7-08fd-40c6-9745-238f1aa2a480 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:35.823956 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-7f6c4dcd-76d6-4466-8ff9-f7abca80a057 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:36.942335 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:38.404679 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:39.177307 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:44.322841 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:58:44.417767 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-272c9368-37de-40b0-997a-399279dd314c req-e24af491-77ca-488a-ac8e-44ea97bdf673 service neutron] (108287) timed out ('10.222.0.61', 61998) {{(pid=108287) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 15 12:58:46.768504 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:58:48.958019 dv-cinder-803823-7-iscsi neutron-server[108286]: DEBUG neutron.wsgi [req-980ccc99-e125-41a0-96e5-211df8d53f92 req-427be185-5806-43cb-9519-5bf516d94172 service neutron] (108286) timed out ('10.222.0.44', 53090) {{(pid=108286) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 15 12:59:03.365393 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-aa91a078-4099-4e38-966e-7a06d947256a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:05.825489 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-d6a8a33a-b155-4e72-98f2-af3583aa5720 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:06.943707 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:08.406714 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:09.178189 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:14.338728 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:23.768996 dv-cinder-803823-7-iscsi neutron-server[108289]: DEBUG neutron.db.agents_db [None req-06c4396b-8371-412b-a152-0f5316ae7423 None None] Agent healthcheck: found 6 active agents {{(pid=108289) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 15 12:59:33.369386 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-f4ec4701-938e-4d76-bf32-314e25742ed3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:35.827405 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-49f4d543-ff16-4ca9-b954-7ddde776deb9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:36.950655 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0c3544ac-655c-48d1-af26-197be0436253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:38.451471 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-ea0154ee-5b7e-45cd-8732-d1c5e4239f17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:39.180960 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-4afd2e30-61ad-4adb-a46c-2855234d3ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:44.351740 dv-cinder-803823-7-iscsi neutron-server[108288]: DEBUG neutron_lib.callbacks.manager [None req-0be39e99-b63b-4928-97fc-403e2862097f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738060767160', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-529050'] for agent, after_update {{(pid=108288) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 15 12:59:44.682176 dv-cinder-803823-7-iscsi neutron-server[108287]: DEBUG neutron.wsgi [req-d415631b-a102-4277-b7ea-81fcdb736775 req-dce213ad-a92a-49a2-8536-87d0c595afcd service neutron] (108287) timed out ('10.222.0.61', 61973) {{(pid=108287) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}}